Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 836012 Details for
Bug 1041857
rest api: rebalance causes hosts to become Non Operational after adding 4 bricks sequentially to a 6 node dist volume
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
vdsm.log
vdsm.log (text/x-log), 1.29 MB, created by
Dustin Tsang
on 2013-12-12 19:47:33 UTC
(
hide
)
Description:
vdsm.log
Filename:
MIME Type:
Creator:
Dustin Tsang
Created:
2013-12-12 19:47:33 UTC
Size:
1.29 MB
patch
obsolete
>MainThread::INFO::2013-12-11 13:03:12,040::vdsm::101::vds::(run) (PID: 2690) I am the actual vdsm 4.13.0-22.el6rhs localhost.localdomain (2.6.32-358.28.1.el6.x86_64) >MainThread::DEBUG::2013-12-11 13:03:12,394::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2013-12-11 13:03:12,395::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::DEBUG::2013-12-11 13:03:12,676::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::INFO::2013-12-11 13:03:12,690::multipath::134::Storage.Multipath::(isEnabled) Manual override for multipath.conf detected - preserving current configuration >MainThread::WARNING::2013-12-11 13:03:12,690::multipath::137::Storage.Multipath::(isEnabled) This manual override for multipath.conf was based on downrevved template. You are strongly advised to contact your support representatives >MainThread::DEBUG::2013-12-11 13:03:12,690::hsm::426::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2013-12-11 13:03:12,753::hsm::426::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-12-11 13:03:12,753::hsm::450::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2013-12-11 13:03:12,755::hsm::482::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2013-12-11 13:03:12,755::hsm::483::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2013-12-11 13:03:12,755::hsm::485::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2013-12-11 13:03:12,756::hsm::528::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2013-12-11 13:03:12,758::dispatcher::98::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >MainThread::DEBUG::2013-12-11 13:03:12,758::task::579::TaskManager.Task::(_updateState) Task=`91a1c37c-9cba-469a-86ef-e9319b6c8a10`::moving from state init -> state preparing >MainThread::INFO::2013-12-11 13:03:12,758::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0x7f77e25c4200>>) >MainThread::INFO::2013-12-11 13:03:12,759::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None >MainThread::DEBUG::2013-12-11 13:03:12,759::task::1168::TaskManager.Task::(prepare) Task=`91a1c37c-9cba-469a-86ef-e9319b6c8a10`::finished: None >MainThread::DEBUG::2013-12-11 13:03:12,759::task::579::TaskManager.Task::(_updateState) Task=`91a1c37c-9cba-469a-86ef-e9319b6c8a10`::moving from state preparing -> state finished >MainThread::DEBUG::2013-12-11 13:03:12,759::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-12-11 13:03:12,759::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-12-11 13:03:12,759::task::974::TaskManager.Task::(_decref) Task=`91a1c37c-9cba-469a-86ef-e9319b6c8a10`::ref 0 aborting False >storageRefresh::DEBUG::2013-12-11 13:03:12,763::lvm::338::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-11 13:03:12,764::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::WARNING::2013-12-11 13:03:12,767::clientIF::196::vds::(_prepareMOM) MOM is not available, fallback to KsmMonitor >MainThread::DEBUG::2013-12-11 13:03:12,768::utils::489::root::(execCmd) '/usr/bin/pgrep -xf ksmd' (cwd None) >MainThread::DEBUG::2013-12-11 13:03:12,969::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2013-12-11 13:03:12,969::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 29 >storageRefresh::DEBUG::2013-12-11 13:03:12,981::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-12-11 13:03:12,981::lvm::363::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-11 13:03:12,982::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-11 13:03:12,982::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >KsmMonitor::DEBUG::2013-12-11 13:03:12,986::utils::489::root::(execCmd) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2013-12-11 13:03:12,990::vmChannels::187::vds::(settimeout) Setting channels' timeout to 30 seconds. >clientIFinit::DEBUG::2013-12-11 13:03:12,991::libvirtconnection::131::libvirtconnection::(get) trying to connect libvirt >VM Channels Listener::INFO::2013-12-11 13:03:13,001::vmChannels::170::vds::(run) Starting VM channels listener thread. >storageRefresh::DEBUG::2013-12-11 13:03:13,081::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-11 13:03:13,081::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-11 13:03:13,082::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >storageRefresh::DEBUG::2013-12-11 13:03:13,140::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-11 13:03:13,140::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-11 13:03:13,141::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >storageRefresh::DEBUG::2013-12-11 13:03:13,188::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-11 13:03:13,188::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-11 13:03:13,188::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >storageRefresh::DEBUG::2013-12-11 13:03:13,188::misc::811::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-12-11 13:03:13,189::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2013-12-11 13:03:13,189::misc::811::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-12-11 13:03:13,189::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2013-12-11 13:03:13,281::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >storageRefresh::DEBUG::2013-12-11 13:03:13,282::misc::819::SamplingMethod::(__call__) Returning last result >storageRefresh::DEBUG::2013-12-11 13:03:15,297::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >storageRefresh::DEBUG::2013-12-11 13:03:15,491::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-12-11 13:03:15,492::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-11 13:03:15,492::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-11 13:03:15,492::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-11 13:03:15,492::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-11 13:03:15,493::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-11 13:03:15,493::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-11 13:03:15,493::misc::819::SamplingMethod::(__call__) Returning last result >KsmMonitor::DEBUG::2013-12-11 13:03:19,216::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2013-12-11 13:03:19,217::utils::489::root::(execCmd) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2013-12-11 13:03:19,262::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2013-12-12 09:05:42,755::vdsm::101::vds::(run) (PID: 2585) I am the actual vdsm 4.13.0-22.el6rhs rhs-21u2-20131208-b (2.6.32-358.28.1.el6.x86_64) >MainThread::DEBUG::2013-12-12 09:05:43,058::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2013-12-12 09:05:43,059::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2013-12-12 09:05:43,062::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2013-12-12 09:05:43,366::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::INFO::2013-12-12 09:05:43,375::multipath::134::Storage.Multipath::(isEnabled) Manual override for multipath.conf detected - preserving current configuration >MainThread::WARNING::2013-12-12 09:05:43,375::multipath::137::Storage.Multipath::(isEnabled) This manual override for multipath.conf was based on downrevved template. You are strongly advised to contact your support representatives >MainThread::DEBUG::2013-12-12 09:05:43,375::hsm::426::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2013-12-12 09:05:43,480::hsm::426::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-12-12 09:05:43,481::hsm::450::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2013-12-12 09:05:43,483::hsm::482::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2013-12-12 09:05:43,483::hsm::483::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2013-12-12 09:05:43,483::hsm::485::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2013-12-12 09:05:43,484::hsm::528::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2013-12-12 09:05:43,485::dispatcher::98::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >MainThread::DEBUG::2013-12-12 09:05:43,485::task::579::TaskManager.Task::(_updateState) Task=`4aacb8df-98bc-4bfd-be74-274b6e147705`::moving from state init -> state preparing >MainThread::INFO::2013-12-12 09:05:43,486::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0x7f739ebf6200>>) >MainThread::INFO::2013-12-12 09:05:43,486::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None >MainThread::DEBUG::2013-12-12 09:05:43,486::task::1168::TaskManager.Task::(prepare) Task=`4aacb8df-98bc-4bfd-be74-274b6e147705`::finished: None >MainThread::DEBUG::2013-12-12 09:05:43,486::task::579::TaskManager.Task::(_updateState) Task=`4aacb8df-98bc-4bfd-be74-274b6e147705`::moving from state preparing -> state finished >MainThread::DEBUG::2013-12-12 09:05:43,486::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-12-12 09:05:43,486::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-12-12 09:05:43,487::task::974::TaskManager.Task::(_decref) Task=`4aacb8df-98bc-4bfd-be74-274b6e147705`::ref 0 aborting False >storageRefresh::DEBUG::2013-12-12 09:05:43,487::lvm::338::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 09:05:43,488::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::WARNING::2013-12-12 09:05:43,499::clientIF::196::vds::(_prepareMOM) MOM is not available, fallback to KsmMonitor >MainThread::DEBUG::2013-12-12 09:05:43,499::utils::489::root::(execCmd) '/usr/bin/pgrep -xf ksmd' (cwd None) >storageRefresh::DEBUG::2013-12-12 09:05:43,534::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 09:05:43,534::lvm::363::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 09:05:43,534::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 09:05:43,535::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >MainThread::DEBUG::2013-12-12 09:05:43,539::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2013-12-12 09:05:43,539::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 29 >KsmMonitor::DEBUG::2013-12-12 09:05:43,543::utils::489::root::(execCmd) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2013-12-12 09:05:43,547::vmChannels::187::vds::(settimeout) Setting channels' timeout to 30 seconds. >clientIFinit::DEBUG::2013-12-12 09:05:43,548::libvirtconnection::131::libvirtconnection::(get) trying to connect libvirt >VM Channels Listener::INFO::2013-12-12 09:05:43,564::vmChannels::170::vds::(run) Starting VM channels listener thread. >storageRefresh::DEBUG::2013-12-12 09:05:43,584::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 09:05:43,584::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 09:05:43,585::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >storageRefresh::DEBUG::2013-12-12 09:05:43,628::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 09:05:43,628::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 09:05:43,629::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >storageRefresh::DEBUG::2013-12-12 09:05:43,667::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 09:05:43,667::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 09:05:43,668::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >storageRefresh::DEBUG::2013-12-12 09:05:43,668::misc::811::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-12-12 09:05:43,668::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2013-12-12 09:05:43,668::misc::811::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-12-12 09:05:43,668::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2013-12-12 09:05:43,696::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >storageRefresh::DEBUG::2013-12-12 09:05:43,696::misc::819::SamplingMethod::(__call__) Returning last result >storageRefresh::DEBUG::2013-12-12 09:05:45,716::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >storageRefresh::DEBUG::2013-12-12 09:05:45,967::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 09:05:45,967::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 09:05:45,968::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 09:05:45,968::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 09:05:45,968::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 09:05:45,969::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 09:05:45,969::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 09:05:45,969::misc::819::SamplingMethod::(__call__) Returning last result >storageRefresh::WARNING::2013-12-12 09:05:45,969::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >KsmMonitor::DEBUG::2013-12-12 09:05:49,661::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2013-12-12 09:05:49,661::utils::489::root::(execCmd) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2013-12-12 09:05:49,883::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2013-12-12 09:15:56,134::vdsm::101::vds::(run) (PID: 2513) I am the actual vdsm 4.13.0-22.el6rhs rhs-21u2-20131208-b (2.6.32-358.28.1.el6.x86_64) >MainThread::DEBUG::2013-12-12 09:15:56,873::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2013-12-12 09:15:56,873::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2013-12-12 09:15:56,877::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2013-12-12 09:15:57,184::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::INFO::2013-12-12 09:15:57,193::multipath::134::Storage.Multipath::(isEnabled) Manual override for multipath.conf detected - preserving current configuration >MainThread::WARNING::2013-12-12 09:15:57,193::multipath::137::Storage.Multipath::(isEnabled) This manual override for multipath.conf was based on downrevved template. You are strongly advised to contact your support representatives >MainThread::DEBUG::2013-12-12 09:15:57,194::hsm::426::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2013-12-12 09:15:57,444::hsm::426::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-12-12 09:15:57,445::hsm::450::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2013-12-12 09:15:57,446::hsm::482::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2013-12-12 09:15:57,447::hsm::483::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2013-12-12 09:15:57,447::hsm::485::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2013-12-12 09:15:57,447::hsm::528::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2013-12-12 09:15:57,449::dispatcher::98::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >MainThread::DEBUG::2013-12-12 09:15:57,449::task::579::TaskManager.Task::(_updateState) Task=`8a24a28e-3852-4e14-a77c-54b7c68a4b53`::moving from state init -> state preparing >MainThread::INFO::2013-12-12 09:15:57,449::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0x7fbb24c14200>>) >MainThread::INFO::2013-12-12 09:15:57,449::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None >MainThread::DEBUG::2013-12-12 09:15:57,450::task::1168::TaskManager.Task::(prepare) Task=`8a24a28e-3852-4e14-a77c-54b7c68a4b53`::finished: None >MainThread::DEBUG::2013-12-12 09:15:57,450::task::579::TaskManager.Task::(_updateState) Task=`8a24a28e-3852-4e14-a77c-54b7c68a4b53`::moving from state preparing -> state finished >MainThread::DEBUG::2013-12-12 09:15:57,450::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-12-12 09:15:57,450::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-12-12 09:15:57,450::task::974::TaskManager.Task::(_decref) Task=`8a24a28e-3852-4e14-a77c-54b7c68a4b53`::ref 0 aborting False >storageRefresh::DEBUG::2013-12-12 09:15:57,454::lvm::338::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 09:15:57,455::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::WARNING::2013-12-12 09:15:57,463::clientIF::196::vds::(_prepareMOM) MOM is not available, fallback to KsmMonitor >MainThread::DEBUG::2013-12-12 09:15:57,463::utils::489::root::(execCmd) '/usr/bin/pgrep -xf ksmd' (cwd None) >MainThread::DEBUG::2013-12-12 09:15:57,487::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2013-12-12 09:15:57,487::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 29 >storageRefresh::DEBUG::2013-12-12 09:15:57,501::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 09:15:57,501::lvm::363::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 09:15:57,502::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 09:15:57,502::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >KsmMonitor::DEBUG::2013-12-12 09:15:57,507::utils::489::root::(execCmd) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2013-12-12 09:15:57,513::vmChannels::187::vds::(settimeout) Setting channels' timeout to 30 seconds. >clientIFinit::DEBUG::2013-12-12 09:15:57,513::libvirtconnection::131::libvirtconnection::(get) trying to connect libvirt >storageRefresh::DEBUG::2013-12-12 09:15:57,583::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 09:15:57,583::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 09:15:57,584::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >VM Channels Listener::INFO::2013-12-12 09:15:57,590::vmChannels::170::vds::(run) Starting VM channels listener thread. >storageRefresh::DEBUG::2013-12-12 09:15:57,672::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 09:15:57,673::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 09:15:57,673::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >storageRefresh::DEBUG::2013-12-12 09:15:57,705::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 09:15:57,706::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 09:15:57,706::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >storageRefresh::DEBUG::2013-12-12 09:15:57,706::misc::811::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-12-12 09:15:57,706::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2013-12-12 09:15:57,707::misc::811::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-12-12 09:15:57,707::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2013-12-12 09:15:57,756::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >storageRefresh::DEBUG::2013-12-12 09:15:57,757::misc::819::SamplingMethod::(__call__) Returning last result >storageRefresh::DEBUG::2013-12-12 09:15:59,768::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >storageRefresh::DEBUG::2013-12-12 09:15:59,990::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 09:15:59,991::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 09:15:59,991::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 09:15:59,991::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 09:15:59,991::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 09:15:59,992::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 09:15:59,992::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 09:15:59,992::misc::819::SamplingMethod::(__call__) Returning last result >storageRefresh::WARNING::2013-12-12 09:15:59,992::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >KsmMonitor::DEBUG::2013-12-12 09:16:02,594::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2013-12-12 09:16:02,595::utils::489::root::(execCmd) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2013-12-12 09:16:02,813::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-12-12 09:42:43,548::vdsm::45::vds::(sigtermHandler) Received signal 15 >MainThread::INFO::2013-12-12 09:42:44,066::vmChannels::183::vds::(stop) VM channels listener was stopped. >MainThread::DEBUG::2013-12-12 09:42:44,067::task::579::TaskManager.Task::(_updateState) Task=`c3070bc3-f358-4984-9927-1ef69fe77ae6`::moving from state init -> state preparing >MainThread::INFO::2013-12-12 09:42:44,067::logUtils::44::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2013-12-12 09:42:44,067::storageServer::698::ConnectionMonitor::(_monitorConnections) Monitoring stopped >VM Channels Listener::INFO::2013-12-12 09:42:44,068::vmChannels::178::vds::(run) VM channels listener thread has ended. >MainThread::DEBUG::2013-12-12 09:42:44,328::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2013-12-12 09:42:44,328::logUtils::47::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2013-12-12 09:42:44,328::task::1168::TaskManager.Task::(prepare) Task=`c3070bc3-f358-4984-9927-1ef69fe77ae6`::finished: None >MainThread::DEBUG::2013-12-12 09:42:44,328::task::579::TaskManager.Task::(_updateState) Task=`c3070bc3-f358-4984-9927-1ef69fe77ae6`::moving from state preparing -> state finished >MainThread::DEBUG::2013-12-12 09:42:44,329::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-12-12 09:42:44,329::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-12-12 09:42:44,329::task::974::TaskManager.Task::(_decref) Task=`c3070bc3-f358-4984-9927-1ef69fe77ae6`::ref 0 aborting False >MainThread::INFO::2013-12-12 09:42:44,329::vdsm::107::vds::(run) VDSM main thread ended. Waiting for 12 other threads... >MainThread::INFO::2013-12-12 09:42:44,329::vdsm::111::vds::(run) <_MainThread(MainThread, started 140441753872128)> >MainThread::INFO::2013-12-12 09:42:44,330::vdsm::111::vds::(run) <Thread(libvirtEventLoop, started daemon 140441534592768)> >MainThread::INFO::2013-12-12 09:42:44,330::vdsm::111::vds::(run) <WorkerThread(Thread-5, started daemon 140441362085632)> >MainThread::INFO::2013-12-12 09:42:44,330::vdsm::111::vds::(run) <WorkerThread(Thread-8, started daemon 140440990902016)> >MainThread::INFO::2013-12-12 09:42:44,330::vdsm::111::vds::(run) <WorkerThread(Thread-10, started daemon 140440969922304)> >MainThread::INFO::2013-12-12 09:42:44,330::vdsm::111::vds::(run) <WorkerThread(Thread-3, started daemon 140441383065344)> >MainThread::INFO::2013-12-12 09:42:44,330::vdsm::111::vds::(run) <WorkerThread(Thread-6, started daemon 140441351595776)> >MainThread::INFO::2013-12-12 09:42:44,330::vdsm::111::vds::(run) <WorkerThread(Thread-2, started daemon 140441393555200)> >MainThread::INFO::2013-12-12 09:42:44,331::vdsm::111::vds::(run) <WorkerThread(Thread-1, started daemon 140441404045056)> >MainThread::INFO::2013-12-12 09:42:44,331::vdsm::111::vds::(run) <WorkerThread(Thread-7, started daemon 140441001391872)> >MainThread::INFO::2013-12-12 09:42:44,331::vdsm::111::vds::(run) <WorkerThread(Thread-9, started daemon 140440980412160)> >MainThread::INFO::2013-12-12 09:42:44,331::vdsm::111::vds::(run) <KsmMonitorThread(KsmMonitor, started daemon 140440789575424)> >MainThread::INFO::2013-12-12 09:42:44,331::vdsm::111::vds::(run) <WorkerThread(Thread-4, started daemon 140441372575488)> >MainThread::INFO::2013-12-12 09:42:47,415::vdsm::101::vds::(run) (PID: 3266) I am the actual vdsm 4.13.0-23.1.el6rhs rhs-21u2-20131208-b (2.6.32-358.28.1.el6.x86_64) >MainThread::DEBUG::2013-12-12 09:42:47,652::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2013-12-12 09:42:47,652::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2013-12-12 09:42:47,655::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2013-12-12 09:42:47,905::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::INFO::2013-12-12 09:42:47,915::multipath::134::Storage.Multipath::(isEnabled) Manual override for multipath.conf detected - preserving current configuration >MainThread::WARNING::2013-12-12 09:42:47,915::multipath::137::Storage.Multipath::(isEnabled) This manual override for multipath.conf was based on downrevved template. You are strongly advised to contact your support representatives >MainThread::DEBUG::2013-12-12 09:42:47,915::hsm::426::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2013-12-12 09:42:48,005::hsm::426::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-12-12 09:42:48,006::hsm::450::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2013-12-12 09:42:48,008::hsm::482::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2013-12-12 09:42:48,008::hsm::483::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2013-12-12 09:42:48,008::hsm::485::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2013-12-12 09:42:48,009::hsm::528::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2013-12-12 09:42:48,010::dispatcher::98::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >MainThread::DEBUG::2013-12-12 09:42:48,011::task::579::TaskManager.Task::(_updateState) Task=`cad72dd4-81e2-48af-b659-75aa70eb1246`::moving from state init -> state preparing >MainThread::INFO::2013-12-12 09:42:48,011::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0x7fcdc64bb200>>) >MainThread::INFO::2013-12-12 09:42:48,011::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None >MainThread::DEBUG::2013-12-12 09:42:48,011::task::1168::TaskManager.Task::(prepare) Task=`cad72dd4-81e2-48af-b659-75aa70eb1246`::finished: None >MainThread::DEBUG::2013-12-12 09:42:48,012::task::579::TaskManager.Task::(_updateState) Task=`cad72dd4-81e2-48af-b659-75aa70eb1246`::moving from state preparing -> state finished >MainThread::DEBUG::2013-12-12 09:42:48,012::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-12-12 09:42:48,012::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-12-12 09:42:48,012::task::974::TaskManager.Task::(_decref) Task=`cad72dd4-81e2-48af-b659-75aa70eb1246`::ref 0 aborting False >storageRefresh::DEBUG::2013-12-12 09:42:48,015::lvm::338::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 09:42:48,016::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::WARNING::2013-12-12 09:42:48,023::clientIF::196::vds::(_prepareMOM) MOM is not available, fallback to KsmMonitor >MainThread::DEBUG::2013-12-12 09:42:48,023::utils::489::root::(execCmd) '/usr/bin/pgrep -xf ksmd' (cwd None) >MainThread::DEBUG::2013-12-12 09:42:48,047::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2013-12-12 09:42:48,048::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 29 >storageRefresh::DEBUG::2013-12-12 09:42:48,060::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 09:42:48,061::lvm::363::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 09:42:48,061::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 09:42:48,062::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >KsmMonitor::DEBUG::2013-12-12 09:42:48,065::utils::489::root::(execCmd) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2013-12-12 09:42:48,070::vmChannels::187::vds::(settimeout) Setting channels' timeout to 30 seconds. >clientIFinit::DEBUG::2013-12-12 09:42:48,070::libvirtconnection::131::libvirtconnection::(get) trying to connect libvirt >VM Channels Listener::INFO::2013-12-12 09:42:48,084::vmChannels::170::vds::(run) Starting VM channels listener thread. >storageRefresh::DEBUG::2013-12-12 09:42:48,113::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 09:42:48,114::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 09:42:48,114::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >storageRefresh::DEBUG::2013-12-12 09:42:48,154::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 09:42:48,155::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 09:42:48,156::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >storageRefresh::DEBUG::2013-12-12 09:42:48,189::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 09:42:48,190::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 09:42:48,190::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >storageRefresh::DEBUG::2013-12-12 09:42:48,190::misc::811::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-12-12 09:42:48,190::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2013-12-12 09:42:48,191::misc::811::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-12-12 09:42:48,191::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2013-12-12 09:42:48,216::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >storageRefresh::DEBUG::2013-12-12 09:42:48,217::misc::819::SamplingMethod::(__call__) Returning last result >storageRefresh::DEBUG::2013-12-12 09:42:50,233::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >storageRefresh::DEBUG::2013-12-12 09:42:50,487::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 09:42:50,488::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 09:42:50,488::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 09:42:50,489::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 09:42:50,489::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 09:42:50,489::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 09:42:50,489::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 09:42:50,490::misc::819::SamplingMethod::(__call__) Returning last result >storageRefresh::WARNING::2013-12-12 09:42:50,490::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >KsmMonitor::DEBUG::2013-12-12 09:42:54,180::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2013-12-12 09:42:54,180::utils::489::root::(execCmd) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2013-12-12 09:42:54,402::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-12-12 09:48:36,798::vdsm::45::vds::(sigtermHandler) Received signal 15 >MainThread::INFO::2013-12-12 09:48:37,510::vmChannels::183::vds::(stop) VM channels listener was stopped. >MainThread::DEBUG::2013-12-12 09:48:37,511::task::579::TaskManager.Task::(_updateState) Task=`0673621f-1b61-4a69-a6cb-f49067e728b7`::moving from state init -> state preparing >MainThread::INFO::2013-12-12 09:48:37,511::logUtils::44::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2013-12-12 09:48:37,511::storageServer::698::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::INFO::2013-12-12 09:48:37,766::domainMonitor::126::Storage.DomainMonitor::(close) Stopping domain monitors >MainThread::DEBUG::2013-12-12 09:48:37,766::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2013-12-12 09:48:37,767::logUtils::47::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2013-12-12 09:48:37,767::task::1168::TaskManager.Task::(prepare) Task=`0673621f-1b61-4a69-a6cb-f49067e728b7`::finished: None >MainThread::DEBUG::2013-12-12 09:48:37,767::task::579::TaskManager.Task::(_updateState) Task=`0673621f-1b61-4a69-a6cb-f49067e728b7`::moving from state preparing -> state finished >MainThread::DEBUG::2013-12-12 09:48:37,767::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-12-12 09:48:37,767::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-12-12 09:48:37,767::task::974::TaskManager.Task::(_decref) Task=`0673621f-1b61-4a69-a6cb-f49067e728b7`::ref 0 aborting False >MainThread::INFO::2013-12-12 09:48:37,768::vdsm::107::vds::(run) VDSM main thread ended. Waiting for 13 other threads... >MainThread::INFO::2013-12-12 09:48:37,768::vdsm::111::vds::(run) <_MainThread(MainThread, started 140521773487872)> >MainThread::INFO::2013-12-12 09:48:37,768::vdsm::111::vds::(run) <Thread(libvirtEventLoop, started daemon 140521553409792)> >MainThread::INFO::2013-12-12 09:48:37,768::vdsm::111::vds::(run) <WorkerThread(Thread-2, started daemon 140521412278016)> >MainThread::INFO::2013-12-12 09:48:37,768::vdsm::111::vds::(run) <WorkerThread(Thread-10, started daemon 140520850450176)> >MainThread::INFO::2013-12-12 09:48:37,768::vdsm::111::vds::(run) <WorkerThread(Thread-1, started daemon 140521422767872)> >MainThread::INFO::2013-12-12 09:48:37,769::vdsm::111::vds::(run) <WorkerThread(Thread-6, started daemon 140521299232512)> >MainThread::INFO::2013-12-12 09:48:37,769::vdsm::111::vds::(run) <WorkerThread(Thread-5, started daemon 140521309722368)> >MainThread::INFO::2013-12-12 09:48:37,769::vdsm::111::vds::(run) <KsmMonitorThread(KsmMonitor, started daemon 140520808490752)> >MainThread::INFO::2013-12-12 09:48:37,769::vdsm::111::vds::(run) <WorkerThread(Thread-8, started daemon 140521278252800)> >MainThread::INFO::2013-12-12 09:48:37,769::vdsm::111::vds::(run) <WorkerThread(Thread-4, started daemon 140521320212224)> >MainThread::INFO::2013-12-12 09:48:37,769::vdsm::111::vds::(run) <WorkerThread(Thread-9, started daemon 140520860940032)> >MainThread::INFO::2013-12-12 09:48:37,769::vdsm::111::vds::(run) <WorkerThread(Thread-7, started daemon 140521288742656)> >MainThread::INFO::2013-12-12 09:48:37,770::vmChannels::183::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2013-12-12 09:48:37,770::vdsm::111::vds::(run) <Listener(VM Channels Listener, started daemon 140520787511040)> >MainThread::INFO::2013-12-12 09:48:37,770::vdsm::111::vds::(run) <WorkerThread(Thread-3, started daemon 140521330702080)> >MainThread::INFO::2013-12-12 09:48:51,851::vdsm::101::vds::(run) (PID: 5049) I am the actual vdsm 4.13.0-23.1.el6rhs rhs-21u2-20131208-b (2.6.32-358.28.1.el6.x86_64) >MainThread::DEBUG::2013-12-12 09:48:52,091::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2013-12-12 09:48:52,091::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2013-12-12 09:48:52,096::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2013-12-12 09:48:52,634::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::INFO::2013-12-12 09:48:52,653::multipath::134::Storage.Multipath::(isEnabled) Manual override for multipath.conf detected - preserving current configuration >MainThread::WARNING::2013-12-12 09:48:52,653::multipath::137::Storage.Multipath::(isEnabled) This manual override for multipath.conf was based on downrevved template. You are strongly advised to contact your support representatives >MainThread::DEBUG::2013-12-12 09:48:52,653::hsm::426::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2013-12-12 09:48:52,688::hsm::426::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-12-12 09:48:52,689::hsm::450::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2013-12-12 09:48:52,691::hsm::482::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2013-12-12 09:48:52,691::hsm::483::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2013-12-12 09:48:52,691::hsm::485::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2013-12-12 09:48:52,692::hsm::528::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2013-12-12 09:48:52,695::dispatcher::98::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >MainThread::DEBUG::2013-12-12 09:48:52,695::task::579::TaskManager.Task::(_updateState) Task=`79fb7988-e4f7-4cc8-aef9-c703b862711e`::moving from state init -> state preparing >MainThread::INFO::2013-12-12 09:48:52,695::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0x7f14bd93f200>>) >MainThread::INFO::2013-12-12 09:48:52,696::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None >MainThread::DEBUG::2013-12-12 09:48:52,696::task::1168::TaskManager.Task::(prepare) Task=`79fb7988-e4f7-4cc8-aef9-c703b862711e`::finished: None >MainThread::DEBUG::2013-12-12 09:48:52,696::task::579::TaskManager.Task::(_updateState) Task=`79fb7988-e4f7-4cc8-aef9-c703b862711e`::moving from state preparing -> state finished >MainThread::DEBUG::2013-12-12 09:48:52,696::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-12-12 09:48:52,696::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-12-12 09:48:52,696::task::974::TaskManager.Task::(_decref) Task=`79fb7988-e4f7-4cc8-aef9-c703b862711e`::ref 0 aborting False >storageRefresh::DEBUG::2013-12-12 09:48:52,700::lvm::338::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 09:48:52,702::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::WARNING::2013-12-12 09:48:52,710::clientIF::196::vds::(_prepareMOM) MOM is not available, fallback to KsmMonitor >MainThread::DEBUG::2013-12-12 09:48:52,710::utils::489::root::(execCmd) '/usr/bin/pgrep -xf ksmd' (cwd None) >MainThread::DEBUG::2013-12-12 09:48:52,758::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2013-12-12 09:48:52,758::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 29 >storageRefresh::DEBUG::2013-12-12 09:48:52,790::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 09:48:52,791::lvm::363::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 09:48:52,791::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 09:48:52,792::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >KsmMonitor::DEBUG::2013-12-12 09:48:52,801::utils::489::root::(execCmd) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2013-12-12 09:48:52,810::vmChannels::187::vds::(settimeout) Setting channels' timeout to 30 seconds. >clientIFinit::DEBUG::2013-12-12 09:48:52,810::libvirtconnection::131::libvirtconnection::(get) trying to connect libvirt >storageRefresh::DEBUG::2013-12-12 09:48:52,845::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 09:48:52,846::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 09:48:52,846::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >VM Channels Listener::INFO::2013-12-12 09:48:52,860::vmChannels::170::vds::(run) Starting VM channels listener thread. >storageRefresh::DEBUG::2013-12-12 09:48:52,894::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 09:48:52,895::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 09:48:52,895::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >storageRefresh::DEBUG::2013-12-12 09:48:52,943::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 09:48:52,944::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 09:48:52,944::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >storageRefresh::DEBUG::2013-12-12 09:48:52,944::misc::811::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-12-12 09:48:52,944::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2013-12-12 09:48:52,945::misc::811::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-12-12 09:48:52,945::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2013-12-12 09:48:52,982::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >storageRefresh::DEBUG::2013-12-12 09:48:52,983::misc::819::SamplingMethod::(__call__) Returning last result >Thread-13::DEBUG::2013-12-12 09:48:53,466::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call ping with () {} flowID [541be121] >Thread-13::DEBUG::2013-12-12 09:48:53,466::BindingXMLRPC::991::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-14::DEBUG::2013-12-12 09:48:53,476::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getCapabilities with () {} flowID [541be121] >Thread-14::DEBUG::2013-12-12 09:48:53,544::utils::489::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-14::DEBUG::2013-12-12 09:48:53,757::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2013-12-12 09:48:53,790::caps::363::root::(_getKeyPackages) rpm package glusterfs-rdma not found >Thread-14::DEBUG::2013-12-12 09:48:53,790::caps::363::root::(_getKeyPackages) rpm package glusterfs-fuse not found >Thread-14::DEBUG::2013-12-12 09:48:53,791::caps::363::root::(_getKeyPackages) rpm package gluster-swift not found >Thread-14::DEBUG::2013-12-12 09:48:53,792::caps::363::root::(_getKeyPackages) rpm package qemu-kvm-rhev not found >Thread-14::DEBUG::2013-12-12 09:48:53,792::caps::363::root::(_getKeyPackages) rpm package gluster-swift-object not found >Thread-14::DEBUG::2013-12-12 09:48:53,792::caps::363::root::(_getKeyPackages) rpm package glusterfs not found >Thread-14::DEBUG::2013-12-12 09:48:53,793::caps::363::root::(_getKeyPackages) rpm package gluster-swift-plugin not found >Thread-14::DEBUG::2013-12-12 09:48:53,794::caps::363::root::(_getKeyPackages) rpm package qemu-img-rhev not found >Thread-14::DEBUG::2013-12-12 09:48:53,794::caps::363::root::(_getKeyPackages) rpm package ('mom',) not found >Thread-14::DEBUG::2013-12-12 09:48:53,794::caps::363::root::(_getKeyPackages) rpm package gluster-swift-account not found >Thread-14::DEBUG::2013-12-12 09:48:53,795::caps::363::root::(_getKeyPackages) rpm package gluster-swift-proxy not found >Thread-14::DEBUG::2013-12-12 09:48:53,795::caps::363::root::(_getKeyPackages) rpm package gluster-swift-doc not found >Thread-14::DEBUG::2013-12-12 09:48:53,795::caps::363::root::(_getKeyPackages) rpm package glusterfs-server not found >Thread-14::DEBUG::2013-12-12 09:48:53,796::caps::363::root::(_getKeyPackages) rpm package gluster-swift-container not found >Thread-14::DEBUG::2013-12-12 09:48:53,796::caps::363::root::(_getKeyPackages) rpm package glusterfs-geo-replication not found >Thread-14::DEBUG::2013-12-12 09:48:53,800::BindingXMLRPC::991::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.28.1.el6.x86_64', 'buildtime': 1384533955.0, 'version': '2.6.32'}, 'vdsm': {'release': '23.1.el6rhs', 'buildtime': 1386773756L, 'version': '4.13.0'}, 'spice-server': {'release': '12.el6_4.5', 'buildtime': 1381834662L, 'version': '0.12.0'}, 'libvirt': {'release': '18.el6_4.13', 'buildtime': 1379320058L, 'version': '0.10.2'}}, 'cpuModel': 'QEMU Virtual CPU version 1.4.2', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {}, 'bridges': {}, 'uuid': '7B904C94-94EE-7B49-40B3-BD3C28FBB749', 'lastClientIface': 'eth0', 'nics': {'eth0': {'netmask': '255.255.255.0', 'addr': '10.14.16.127', 'hwaddr': '52:54:00:b7:60:bc', 'cfg': {'IPV6INIT': 'yes', 'NM_CONTROLLED': 'yes', 'IPV6_AUTOCONF': 'yes', 'HWADDR': '52:54:00:b7:60:bc', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'yes', 'UUID': '7650d3ac-8678-4dd7-8db7-2693bb24ecf9'}, 'ipv6addrs': [], 'speed': 100, 'mtu': '1500'}}, 'software_revision': '23.1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': 'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,lm,up,rep_good,unfair_spinlock,pni,cx16,popcnt,hypervisor,lahf_lm', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '4062', 'cpuSpeed': '2393.998', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '1', 'kvmEnabled': 'false', 'rhsVersion': {'release': '1.el6rhs', 'version': '2.1.2.0', 'name': 'RHS'}, 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '1', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.14.16.112'}} >Thread-15::DEBUG::2013-12-12 09:48:53,860::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call setupNetworks with ({'ovirtmgmt': {'nic': 'eth0', 'bootproto': 'dhcp', 'STP': 'no', 'bridged': 'true'}}, {}, {'connectivityCheck': 'true', 'connectivityTimeout': 120}) {} flowID [12536994] >Thread-16::DEBUG::2013-12-12 09:48:53,877::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call ping with () {} flowID [12536994] >Thread-16::DEBUG::2013-12-12 09:48:53,878::BindingXMLRPC::991::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >storageRefresh::DEBUG::2013-12-12 09:48:57,063::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >storageRefresh::DEBUG::2013-12-12 09:48:57,100::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 09:48:57,100::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 09:48:57,100::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 09:48:57,101::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 09:48:57,101::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 09:48:57,101::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 09:48:57,101::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 09:48:57,102::misc::819::SamplingMethod::(__call__) Returning last result >storageRefresh::WARNING::2013-12-12 09:48:57,102::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >KsmMonitor::DEBUG::2013-12-12 09:48:59,014::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2013-12-12 09:48:59,015::utils::489::root::(execCmd) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2013-12-12 09:48:59,061::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2013-12-12 09:48:59,397::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call ping with () {} flowID [12536994] >Thread-17::DEBUG::2013-12-12 09:48:59,398::BindingXMLRPC::991::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-18::DEBUG::2013-12-12 09:48:59,404::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call ping with () {} flowID [12536994] >Thread-18::DEBUG::2013-12-12 09:48:59,405::BindingXMLRPC::991::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-19::DEBUG::2013-12-12 09:48:59,911::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call ping with () {} flowID [12536994] >Thread-19::DEBUG::2013-12-12 09:48:59,912::BindingXMLRPC::991::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-20::DEBUG::2013-12-12 09:49:00,421::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call ping with () {} flowID [12536994] >Thread-20::DEBUG::2013-12-12 09:49:00,421::BindingXMLRPC::991::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-15::DEBUG::2013-12-12 09:49:00,642::BindingXMLRPC::991::vds::(wrapper) return setupNetworks with {'status': {'message': 'Done', 'code': 0}} >Thread-21::DEBUG::2013-12-12 09:49:00,934::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getCapabilities with () {} flowID [12536994] >Thread-21::DEBUG::2013-12-12 09:49:00,935::utils::489::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-21::DEBUG::2013-12-12 09:49:00,940::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-21::DEBUG::2013-12-12 09:49:00,952::caps::363::root::(_getKeyPackages) rpm package glusterfs-rdma not found >Thread-21::DEBUG::2013-12-12 09:49:00,952::caps::363::root::(_getKeyPackages) rpm package glusterfs-fuse not found >Thread-21::DEBUG::2013-12-12 09:49:00,953::caps::363::root::(_getKeyPackages) rpm package gluster-swift not found >Thread-21::DEBUG::2013-12-12 09:49:00,954::caps::363::root::(_getKeyPackages) rpm package qemu-kvm-rhev not found >Thread-21::DEBUG::2013-12-12 09:49:00,954::caps::363::root::(_getKeyPackages) rpm package gluster-swift-object not found >Thread-21::DEBUG::2013-12-12 09:49:00,954::caps::363::root::(_getKeyPackages) rpm package glusterfs not found >Thread-21::DEBUG::2013-12-12 09:49:00,955::caps::363::root::(_getKeyPackages) rpm package gluster-swift-plugin not found >Thread-21::DEBUG::2013-12-12 09:49:00,956::caps::363::root::(_getKeyPackages) rpm package qemu-img-rhev not found >Thread-21::DEBUG::2013-12-12 09:49:00,956::caps::363::root::(_getKeyPackages) rpm package ('mom',) not found >Thread-21::DEBUG::2013-12-12 09:49:00,957::caps::363::root::(_getKeyPackages) rpm package gluster-swift-account not found >Thread-21::DEBUG::2013-12-12 09:49:00,957::caps::363::root::(_getKeyPackages) rpm package gluster-swift-proxy not found >Thread-21::DEBUG::2013-12-12 09:49:00,957::caps::363::root::(_getKeyPackages) rpm package gluster-swift-doc not found >Thread-21::DEBUG::2013-12-12 09:49:00,957::caps::363::root::(_getKeyPackages) rpm package glusterfs-server not found >Thread-21::DEBUG::2013-12-12 09:49:00,958::caps::363::root::(_getKeyPackages) rpm package gluster-swift-container not found >Thread-21::DEBUG::2013-12-12 09:49:00,958::caps::363::root::(_getKeyPackages) rpm package glusterfs-geo-replication not found >Thread-21::DEBUG::2013-12-12 09:49:00,959::BindingXMLRPC::991::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.28.1.el6.x86_64', 'buildtime': 1384533955.0, 'version': '2.6.32'}, 'vdsm': {'release': '23.1.el6rhs', 'buildtime': 1386773756L, 'version': '4.13.0'}, 'spice-server': {'release': '12.el6_4.5', 'buildtime': 1381834662L, 'version': '0.12.0'}, 'libvirt': {'release': '18.el6_4.13', 'buildtime': 1379320058L, 'version': '0.10.2'}}, 'cpuModel': 'QEMU Virtual CPU version 1.4.2', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.14.16.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.14.16.254', 'ports': ['eth0']}}, 'uuid': '7B904C94-94EE-7B49-40B3-BD3C28FBB749', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'netmask': '', 'addr': '', 'hwaddr': '52:54:00:b7:60:bc', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': '52:54:00:b7:60:bc', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 100, 'mtu': '1500'}}, 'software_revision': '23.1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': 'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,lm,up,rep_good,unfair_spinlock,pni,cx16,popcnt,hypervisor,lahf_lm', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f', 'netConfigDirty': 'True', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '4062', 'cpuSpeed': '2393.998', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '1', 'kvmEnabled': 'false', 'rhsVersion': {'release': '1.el6rhs', 'version': '2.1.2.0', 'name': 'RHS'}, 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '1', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.14.16.112'}} >Thread-22::DEBUG::2013-12-12 09:49:01,131::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call setSafeNetworkConfig with () {} flowID [65cef7bc] >Thread-22::DEBUG::2013-12-12 09:49:01,142::BindingXMLRPC::991::vds::(wrapper) return setSafeNetworkConfig with {'status': {'message': 'Done', 'code': 0}} >Thread-23::DEBUG::2013-12-12 09:49:03,527::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getCapabilities with () {} >Thread-23::DEBUG::2013-12-12 09:49:03,527::utils::489::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-23::DEBUG::2013-12-12 09:49:03,532::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-23::DEBUG::2013-12-12 09:49:03,544::caps::363::root::(_getKeyPackages) rpm package glusterfs-rdma not found >Thread-23::DEBUG::2013-12-12 09:49:03,544::caps::363::root::(_getKeyPackages) rpm package glusterfs-fuse not found >Thread-23::DEBUG::2013-12-12 09:49:03,545::caps::363::root::(_getKeyPackages) rpm package gluster-swift not found >Thread-23::DEBUG::2013-12-12 09:49:03,546::caps::363::root::(_getKeyPackages) rpm package qemu-kvm-rhev not found >Thread-23::DEBUG::2013-12-12 09:49:03,546::caps::363::root::(_getKeyPackages) rpm package gluster-swift-object not found >Thread-23::DEBUG::2013-12-12 09:49:03,546::caps::363::root::(_getKeyPackages) rpm package glusterfs not found >Thread-23::DEBUG::2013-12-12 09:49:03,546::caps::363::root::(_getKeyPackages) rpm package gluster-swift-plugin not found >Thread-23::DEBUG::2013-12-12 09:49:03,548::caps::363::root::(_getKeyPackages) rpm package qemu-img-rhev not found >Thread-23::DEBUG::2013-12-12 09:49:03,548::caps::363::root::(_getKeyPackages) rpm package ('mom',) not found >Thread-23::DEBUG::2013-12-12 09:49:03,548::caps::363::root::(_getKeyPackages) rpm package gluster-swift-account not found >Thread-23::DEBUG::2013-12-12 09:49:03,549::caps::363::root::(_getKeyPackages) rpm package gluster-swift-proxy not found >Thread-23::DEBUG::2013-12-12 09:49:03,549::caps::363::root::(_getKeyPackages) rpm package gluster-swift-doc not found >Thread-23::DEBUG::2013-12-12 09:49:03,549::caps::363::root::(_getKeyPackages) rpm package glusterfs-server not found >Thread-23::DEBUG::2013-12-12 09:49:03,549::caps::363::root::(_getKeyPackages) rpm package gluster-swift-container not found >Thread-23::DEBUG::2013-12-12 09:49:03,550::caps::363::root::(_getKeyPackages) rpm package glusterfs-geo-replication not found >Thread-23::DEBUG::2013-12-12 09:49:03,551::BindingXMLRPC::991::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.28.1.el6.x86_64', 'buildtime': 1384533955.0, 'version': '2.6.32'}, 'vdsm': {'release': '23.1.el6rhs', 'buildtime': 1386773756L, 'version': '4.13.0'}, 'spice-server': {'release': '12.el6_4.5', 'buildtime': 1381834662L, 'version': '0.12.0'}, 'libvirt': {'release': '18.el6_4.13', 'buildtime': 1379320058L, 'version': '0.10.2'}}, 'cpuModel': 'QEMU Virtual CPU version 1.4.2', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.14.16.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.14.16.254', 'ports': ['eth0']}}, 'uuid': '7B904C94-94EE-7B49-40B3-BD3C28FBB749', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'netmask': '', 'addr': '', 'hwaddr': '52:54:00:b7:60:bc', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': '52:54:00:b7:60:bc', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 100, 'mtu': '1500'}}, 'software_revision': '23.1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': 'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,lm,up,rep_good,unfair_spinlock,pni,cx16,popcnt,hypervisor,lahf_lm', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '4062', 'cpuSpeed': '2393.998', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '1', 'kvmEnabled': 'false', 'rhsVersion': {'release': '1.el6rhs', 'version': '2.1.2.0', 'name': 'RHS'}, 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '1', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.14.16.112'}} >Thread-24::DEBUG::2013-12-12 09:49:03,567::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getHardwareInfo with () {} >Thread-24::DEBUG::2013-12-12 09:49:03,597::BindingXMLRPC::991::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'Bochs', 'systemSerialNumber': 'Not Specified', 'systemFamily': 'Not Specified', 'systemVersion': 'Not Specified', 'systemUUID': '7b904c94-94ee-7b49-40b3-bd3c28fbb749', 'systemManufacturer': 'Bochs'}} >Thread-25::DEBUG::2013-12-12 09:49:03,624::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-25::DEBUG::2013-12-12 09:49:04,209::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': 'eeb1b2a2-1226-48ff-a6e7-406cff243293'}]} >Thread-26::DEBUG::2013-12-12 09:49:04,220::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getCapabilities with () {} >Thread-26::DEBUG::2013-12-12 09:49:04,220::utils::489::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-26::DEBUG::2013-12-12 09:49:04,226::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-26::DEBUG::2013-12-12 09:49:04,238::caps::363::root::(_getKeyPackages) rpm package glusterfs-rdma not found >Thread-26::DEBUG::2013-12-12 09:49:04,238::caps::363::root::(_getKeyPackages) rpm package glusterfs-fuse not found >Thread-26::DEBUG::2013-12-12 09:49:04,238::caps::363::root::(_getKeyPackages) rpm package gluster-swift not found >Thread-26::DEBUG::2013-12-12 09:49:04,239::caps::363::root::(_getKeyPackages) rpm package qemu-kvm-rhev not found >Thread-26::DEBUG::2013-12-12 09:49:04,239::caps::363::root::(_getKeyPackages) rpm package gluster-swift-object not found >Thread-26::DEBUG::2013-12-12 09:49:04,240::caps::363::root::(_getKeyPackages) rpm package glusterfs not found >Thread-26::DEBUG::2013-12-12 09:49:04,240::caps::363::root::(_getKeyPackages) rpm package gluster-swift-plugin not found >Thread-26::DEBUG::2013-12-12 09:49:04,241::caps::363::root::(_getKeyPackages) rpm package qemu-img-rhev not found >Thread-26::DEBUG::2013-12-12 09:49:04,242::caps::363::root::(_getKeyPackages) rpm package ('mom',) not found >Thread-26::DEBUG::2013-12-12 09:49:04,242::caps::363::root::(_getKeyPackages) rpm package gluster-swift-account not found >Thread-26::DEBUG::2013-12-12 09:49:04,242::caps::363::root::(_getKeyPackages) rpm package gluster-swift-proxy not found >Thread-26::DEBUG::2013-12-12 09:49:04,242::caps::363::root::(_getKeyPackages) rpm package gluster-swift-doc not found >Thread-26::DEBUG::2013-12-12 09:49:04,243::caps::363::root::(_getKeyPackages) rpm package glusterfs-server not found >Thread-26::DEBUG::2013-12-12 09:49:04,243::caps::363::root::(_getKeyPackages) rpm package gluster-swift-container not found >Thread-26::DEBUG::2013-12-12 09:49:04,243::caps::363::root::(_getKeyPackages) rpm package glusterfs-geo-replication not found >Thread-26::DEBUG::2013-12-12 09:49:04,244::BindingXMLRPC::991::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.28.1.el6.x86_64', 'buildtime': 1384533955.0, 'version': '2.6.32'}, 'vdsm': {'release': '23.1.el6rhs', 'buildtime': 1386773756L, 'version': '4.13.0'}, 'spice-server': {'release': '12.el6_4.5', 'buildtime': 1381834662L, 'version': '0.12.0'}, 'libvirt': {'release': '18.el6_4.13', 'buildtime': 1379320058L, 'version': '0.10.2'}}, 'cpuModel': 'QEMU Virtual CPU version 1.4.2', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.14.16.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.14.16.254', 'ports': ['eth0']}}, 'uuid': '7B904C94-94EE-7B49-40B3-BD3C28FBB749', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'netmask': '', 'addr': '', 'hwaddr': '52:54:00:b7:60:bc', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': '52:54:00:b7:60:bc', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 100, 'mtu': '1500'}}, 'software_revision': '23.1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': 'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,lm,up,rep_good,unfair_spinlock,pni,cx16,popcnt,hypervisor,lahf_lm', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '4062', 'cpuSpeed': '2393.998', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '1', 'kvmEnabled': 'false', 'rhsVersion': {'release': '1.el6rhs', 'version': '2.1.2.0', 'name': 'RHS'}, 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '1', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.14.16.112'}} >Thread-27::DEBUG::2013-12-12 09:49:04,260::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getHardwareInfo with () {} >Thread-27::DEBUG::2013-12-12 09:49:04,262::BindingXMLRPC::991::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'Bochs', 'systemSerialNumber': 'Not Specified', 'systemFamily': 'Not Specified', 'systemVersion': 'Not Specified', 'systemUUID': '7b904c94-94ee-7b49-40b3-bd3c28fbb749', 'systemManufacturer': 'Bochs'}} >Thread-28::DEBUG::2013-12-12 09:49:04,289::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-28::DEBUG::2013-12-12 09:49:04,619::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': 'eeb1b2a2-1226-48ff-a6e7-406cff243293'}]} >Thread-30::DEBUG::2013-12-12 09:49:04,647::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostUUIDGet with () {} flowID [69218b42] >Thread-30::DEBUG::2013-12-12 09:49:04,815::BindingXMLRPC::991::vds::(wrapper) return hostUUIDGet with {'status': {'message': 'Done', 'code': 0}, 'uuid': 'eeb1b2a2-1226-48ff-a6e7-406cff243293'} >Thread-31::DEBUG::2013-12-12 09:49:08,385::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-31::DEBUG::2013-12-12 09:49:08,721::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': 'eeb1b2a2-1226-48ff-a6e7-406cff243293'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'e5e6d634-7ebc-4a8f-a2ca-d5f9ac17ef06'}]} >Thread-32::DEBUG::2013-12-12 09:49:08,729::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-32::DEBUG::2013-12-12 09:49:08,899::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-33::DEBUG::2013-12-12 09:49:09,844::task::579::TaskManager.Task::(_updateState) Task=`82a45fd3-acb0-4d85-a4eb-fda679e4f0bb`::moving from state init -> state preparing >Thread-33::INFO::2013-12-12 09:49:09,844::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-33::INFO::2013-12-12 09:49:09,845::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-33::DEBUG::2013-12-12 09:49:09,845::task::1168::TaskManager.Task::(prepare) Task=`82a45fd3-acb0-4d85-a4eb-fda679e4f0bb`::finished: {} >Thread-33::DEBUG::2013-12-12 09:49:09,845::task::579::TaskManager.Task::(_updateState) Task=`82a45fd3-acb0-4d85-a4eb-fda679e4f0bb`::moving from state preparing -> state finished >Thread-33::DEBUG::2013-12-12 09:49:09,845::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-33::DEBUG::2013-12-12 09:49:09,845::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-33::DEBUG::2013-12-12 09:49:09,845::task::974::TaskManager.Task::(_decref) Task=`82a45fd3-acb0-4d85-a4eb-fda679e4f0bb`::ref 0 aborting False >Thread-35::DEBUG::2013-12-12 09:49:11,001::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeCreate with ('StartMigrationDuringRebalanceTest', ['latest-a:/bricks/201312120949084721942637805', 'latest-a:/bricks/20131212094909398850249563', 'latest-a:/bricks/201312120949093981245056192', 'latest-b:/bricks/20131212094909398550199115', 'latest-b:/bricks/20131212094909398516730110', 'latest-b:/bricks/201312120949093981287551485'], 0, 0, ['TCP'], False) {} flowID [7d329531] >Thread-35::DEBUG::2013-12-12 09:49:17,077::BindingXMLRPC::991::vds::(wrapper) return volumeCreate with {'status': {'message': 'Done', 'code': 0}, 'uuid': '638f254c-c650-409a-9ab5-6fbfe5dccb70'} >Thread-39::DEBUG::2013-12-12 09:49:19,248::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeStart with ('StartMigrationDuringRebalanceTest', False) {} flowID [1002ce6f] >Thread-39::DEBUG::2013-12-12 09:49:24,888::BindingXMLRPC::991::vds::(wrapper) return volumeStart with {'status': {'message': 'Done', 'code': 0}} >Thread-41::DEBUG::2013-12-12 09:49:24,961::task::579::TaskManager.Task::(_updateState) Task=`1148719f-97ec-47b5-ae7d-dd26a139b719`::moving from state init -> state preparing >Thread-41::INFO::2013-12-12 09:49:24,962::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-41::INFO::2013-12-12 09:49:24,962::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-41::DEBUG::2013-12-12 09:49:24,962::task::1168::TaskManager.Task::(prepare) Task=`1148719f-97ec-47b5-ae7d-dd26a139b719`::finished: {} >Thread-41::DEBUG::2013-12-12 09:49:24,962::task::579::TaskManager.Task::(_updateState) Task=`1148719f-97ec-47b5-ae7d-dd26a139b719`::moving from state preparing -> state finished >Thread-41::DEBUG::2013-12-12 09:49:24,962::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-41::DEBUG::2013-12-12 09:49:24,963::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-41::DEBUG::2013-12-12 09:49:24,963::task::974::TaskManager.Task::(_decref) Task=`1148719f-97ec-47b5-ae7d-dd26a139b719`::ref 0 aborting False >Thread-46::DEBUG::2013-12-12 09:49:34,358::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeBrickAdd with ('StartMigrationDuringRebalanceTest', ['latest-b:/bricks/20131212094933681927299489'], 0, 0, False) {} flowID [41e982e4] >Thread-48::DEBUG::2013-12-12 09:49:40,129::task::579::TaskManager.Task::(_updateState) Task=`61042fcd-b2e8-4f08-b5e7-14c69f954324`::moving from state init -> state preparing >Thread-48::INFO::2013-12-12 09:49:40,129::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-48::INFO::2013-12-12 09:49:40,129::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-48::DEBUG::2013-12-12 09:49:40,129::task::1168::TaskManager.Task::(prepare) Task=`61042fcd-b2e8-4f08-b5e7-14c69f954324`::finished: {} >Thread-48::DEBUG::2013-12-12 09:49:40,130::task::579::TaskManager.Task::(_updateState) Task=`61042fcd-b2e8-4f08-b5e7-14c69f954324`::moving from state preparing -> state finished >Thread-48::DEBUG::2013-12-12 09:49:40,130::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2013-12-12 09:49:40,130::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2013-12-12 09:49:40,130::task::974::TaskManager.Task::(_decref) Task=`61042fcd-b2e8-4f08-b5e7-14c69f954324`::ref 0 aborting False >Thread-46::DEBUG::2013-12-12 09:49:42,196::BindingXMLRPC::991::vds::(wrapper) return volumeBrickAdd with {'status': {'message': 'Done', 'code': 0}} >Thread-50::DEBUG::2013-12-12 09:49:42,279::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-50::DEBUG::2013-12-12 09:49:42,626::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': 'eeb1b2a2-1226-48ff-a6e7-406cff243293'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'e5e6d634-7ebc-4a8f-a2ca-d5f9ac17ef06'}]} >Thread-51::DEBUG::2013-12-12 09:49:42,634::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-51::DEBUG::2013-12-12 09:49:42,803::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '638f254c-c650-409a-9ab5-6fbfe5dccb70', 'bricks': ['latest-a:/bricks/201312120949084721942637805', 'latest-a:/bricks/20131212094909398850249563', 'latest-a:/bricks/201312120949093981245056192', 'latest-b:/bricks/20131212094909398550199115', 'latest-b:/bricks/20131212094909398516730110', 'latest-b:/bricks/201312120949093981287551485', 'latest-b:/bricks/20131212094933681927299489'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '7', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-56::DEBUG::2013-12-12 09:49:52,643::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-56::DEBUG::2013-12-12 09:49:53,048::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': 'eeb1b2a2-1226-48ff-a6e7-406cff243293'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'e5e6d634-7ebc-4a8f-a2ca-d5f9ac17ef06'}]} >Thread-57::DEBUG::2013-12-12 09:49:53,056::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-57::DEBUG::2013-12-12 09:49:53,222::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '638f254c-c650-409a-9ab5-6fbfe5dccb70', 'bricks': ['latest-a:/bricks/201312120949084721942637805', 'latest-a:/bricks/20131212094909398850249563', 'latest-a:/bricks/201312120949093981245056192', 'latest-b:/bricks/20131212094909398550199115', 'latest-b:/bricks/20131212094909398516730110', 'latest-b:/bricks/201312120949093981287551485', 'latest-b:/bricks/20131212094933681927299489', 'latest-a:/bricks/20131212094943396341374234'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '8', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-58::DEBUG::2013-12-12 09:49:55,281::task::579::TaskManager.Task::(_updateState) Task=`5ba63e37-4f4f-472a-8dac-294eac3b7d97`::moving from state init -> state preparing >Thread-58::INFO::2013-12-12 09:49:55,281::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-58::INFO::2013-12-12 09:49:55,281::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-58::DEBUG::2013-12-12 09:49:55,281::task::1168::TaskManager.Task::(prepare) Task=`5ba63e37-4f4f-472a-8dac-294eac3b7d97`::finished: {} >Thread-58::DEBUG::2013-12-12 09:49:55,281::task::579::TaskManager.Task::(_updateState) Task=`5ba63e37-4f4f-472a-8dac-294eac3b7d97`::moving from state preparing -> state finished >Thread-58::DEBUG::2013-12-12 09:49:55,282::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-58::DEBUG::2013-12-12 09:49:55,282::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-58::DEBUG::2013-12-12 09:49:55,282::task::974::TaskManager.Task::(_decref) Task=`5ba63e37-4f4f-472a-8dac-294eac3b7d97`::ref 0 aborting False >Thread-63::DEBUG::2013-12-12 09:50:04,727::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-63::DEBUG::2013-12-12 09:50:05,144::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': 'eeb1b2a2-1226-48ff-a6e7-406cff243293'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'e5e6d634-7ebc-4a8f-a2ca-d5f9ac17ef06'}]} >Thread-64::DEBUG::2013-12-12 09:50:05,157::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-64::DEBUG::2013-12-12 09:50:05,327::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '638f254c-c650-409a-9ab5-6fbfe5dccb70', 'bricks': ['latest-a:/bricks/201312120949084721942637805', 'latest-a:/bricks/20131212094909398850249563', 'latest-a:/bricks/201312120949093981245056192', 'latest-b:/bricks/20131212094909398550199115', 'latest-b:/bricks/20131212094909398516730110', 'latest-b:/bricks/201312120949093981287551485', 'latest-b:/bricks/20131212094933681927299489', 'latest-a:/bricks/20131212094943396341374234', 'latest-b:/bricks/20131212094953086219930446'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '9', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-65::DEBUG::2013-12-12 09:50:05,380::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeBrickAdd with ('StartMigrationDuringRebalanceTest', ['latest-a:/bricks/201312120950051631151947411'], 0, 0, False) {} flowID [563c3579] >Thread-67::DEBUG::2013-12-12 09:50:10,584::task::579::TaskManager.Task::(_updateState) Task=`705b1990-70fa-4f69-bb88-3d4e6094fbf7`::moving from state init -> state preparing >Thread-67::INFO::2013-12-12 09:50:10,584::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-67::INFO::2013-12-12 09:50:10,584::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-67::DEBUG::2013-12-12 09:50:10,584::task::1168::TaskManager.Task::(prepare) Task=`705b1990-70fa-4f69-bb88-3d4e6094fbf7`::finished: {} >Thread-67::DEBUG::2013-12-12 09:50:10,584::task::579::TaskManager.Task::(_updateState) Task=`705b1990-70fa-4f69-bb88-3d4e6094fbf7`::moving from state preparing -> state finished >Thread-67::DEBUG::2013-12-12 09:50:10,585::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2013-12-12 09:50:10,585::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2013-12-12 09:50:10,585::task::974::TaskManager.Task::(_decref) Task=`705b1990-70fa-4f69-bb88-3d4e6094fbf7`::ref 0 aborting False >Thread-65::DEBUG::2013-12-12 09:50:15,680::BindingXMLRPC::991::vds::(wrapper) return volumeBrickAdd with {'status': {'message': 'Done', 'code': 0}} >Thread-73::DEBUG::2013-12-12 09:50:25,971::task::579::TaskManager.Task::(_updateState) Task=`e24d6e25-ffc4-4524-adb8-9e25b097d6f5`::moving from state init -> state preparing >Thread-73::INFO::2013-12-12 09:50:25,971::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-73::INFO::2013-12-12 09:50:25,971::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-73::DEBUG::2013-12-12 09:50:25,972::task::1168::TaskManager.Task::(prepare) Task=`e24d6e25-ffc4-4524-adb8-9e25b097d6f5`::finished: {} >Thread-73::DEBUG::2013-12-12 09:50:25,972::task::579::TaskManager.Task::(_updateState) Task=`e24d6e25-ffc4-4524-adb8-9e25b097d6f5`::moving from state preparing -> state finished >Thread-73::DEBUG::2013-12-12 09:50:25,972::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2013-12-12 09:50:25,972::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2013-12-12 09:50:25,972::task::974::TaskManager.Task::(_decref) Task=`e24d6e25-ffc4-4524-adb8-9e25b097d6f5`::ref 0 aborting False >Thread-77::DEBUG::2013-12-12 09:50:32,454::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} flowID [4419e6ac] >Thread-77::DEBUG::2013-12-12 09:50:32,805::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': 'eeb1b2a2-1226-48ff-a6e7-406cff243293'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'e5e6d634-7ebc-4a8f-a2ca-d5f9ac17ef06'}]} >Thread-78::DEBUG::2013-12-12 09:50:32,818::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} flowID [4419e6ac] >Thread-78::DEBUG::2013-12-12 09:50:32,984::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '638f254c-c650-409a-9ab5-6fbfe5dccb70', 'bricks': ['latest-a:/bricks/201312120949084721942637805', 'latest-a:/bricks/20131212094909398850249563', 'latest-a:/bricks/201312120949093981245056192', 'latest-b:/bricks/20131212094909398550199115', 'latest-b:/bricks/20131212094909398516730110', 'latest-b:/bricks/201312120949093981287551485', 'latest-b:/bricks/20131212094933681927299489', 'latest-a:/bricks/20131212094943396341374234', 'latest-b:/bricks/20131212094953086219930446', 'latest-a:/bricks/201312120950051631151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-81::DEBUG::2013-12-12 09:50:41,085::task::579::TaskManager.Task::(_updateState) Task=`3a334187-5178-4af7-aeea-a8ef1aeb7f42`::moving from state init -> state preparing >Thread-81::INFO::2013-12-12 09:50:41,085::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-81::INFO::2013-12-12 09:50:41,086::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-81::DEBUG::2013-12-12 09:50:41,086::task::1168::TaskManager.Task::(prepare) Task=`3a334187-5178-4af7-aeea-a8ef1aeb7f42`::finished: {} >Thread-81::DEBUG::2013-12-12 09:50:41,086::task::579::TaskManager.Task::(_updateState) Task=`3a334187-5178-4af7-aeea-a8ef1aeb7f42`::moving from state preparing -> state finished >Thread-81::DEBUG::2013-12-12 09:50:41,086::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-81::DEBUG::2013-12-12 09:50:41,086::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-81::DEBUG::2013-12-12 09:50:41,086::task::974::TaskManager.Task::(_decref) Task=`3a334187-5178-4af7-aeea-a8ef1aeb7f42`::ref 0 aborting False >Thread-83::DEBUG::2013-12-12 09:50:43,611::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-83::DEBUG::2013-12-12 09:50:43,949::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': 'eeb1b2a2-1226-48ff-a6e7-406cff243293'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'e5e6d634-7ebc-4a8f-a2ca-d5f9ac17ef06'}]} >Thread-84::DEBUG::2013-12-12 09:50:43,959::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-84::DEBUG::2013-12-12 09:50:44,128::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '638f254c-c650-409a-9ab5-6fbfe5dccb70', 'bricks': ['latest-a:/bricks/201312120949084721942637805', 'latest-a:/bricks/20131212094909398850249563', 'latest-a:/bricks/201312120949093981245056192', 'latest-b:/bricks/20131212094909398550199115', 'latest-b:/bricks/20131212094909398516730110', 'latest-b:/bricks/201312120949093981287551485', 'latest-b:/bricks/20131212094933681927299489', 'latest-a:/bricks/20131212094943396341374234', 'latest-b:/bricks/20131212094953086219930446', 'latest-a:/bricks/201312120950051631151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-87::DEBUG::2013-12-12 09:50:49,153::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-87::DEBUG::2013-12-12 09:50:49,481::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': 'eeb1b2a2-1226-48ff-a6e7-406cff243293'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'e5e6d634-7ebc-4a8f-a2ca-d5f9ac17ef06'}]} >Thread-88::DEBUG::2013-12-12 09:50:49,489::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-88::DEBUG::2013-12-12 09:50:49,656::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '638f254c-c650-409a-9ab5-6fbfe5dccb70', 'bricks': ['latest-a:/bricks/201312120949084721942637805', 'latest-a:/bricks/20131212094909398850249563', 'latest-a:/bricks/201312120949093981245056192', 'latest-b:/bricks/20131212094909398550199115', 'latest-b:/bricks/20131212094909398516730110', 'latest-b:/bricks/201312120949093981287551485', 'latest-b:/bricks/20131212094933681927299489', 'latest-a:/bricks/20131212094943396341374234', 'latest-b:/bricks/20131212094953086219930446', 'latest-a:/bricks/201312120950051631151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-91::DEBUG::2013-12-12 09:50:56,222::task::579::TaskManager.Task::(_updateState) Task=`479f8177-4fce-4a9b-bd40-0501ddd86cda`::moving from state init -> state preparing >Thread-91::INFO::2013-12-12 09:50:56,222::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-91::INFO::2013-12-12 09:50:56,222::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-91::DEBUG::2013-12-12 09:50:56,222::task::1168::TaskManager.Task::(prepare) Task=`479f8177-4fce-4a9b-bd40-0501ddd86cda`::finished: {} >Thread-91::DEBUG::2013-12-12 09:50:56,222::task::579::TaskManager.Task::(_updateState) Task=`479f8177-4fce-4a9b-bd40-0501ddd86cda`::moving from state preparing -> state finished >Thread-91::DEBUG::2013-12-12 09:50:56,223::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-91::DEBUG::2013-12-12 09:50:56,223::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-91::DEBUG::2013-12-12 09:50:56,223::task::974::TaskManager.Task::(_decref) Task=`479f8177-4fce-4a9b-bd40-0501ddd86cda`::ref 0 aborting False >Thread-94::DEBUG::2013-12-12 09:51:00,222::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-94::DEBUG::2013-12-12 09:51:00,570::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': 'eeb1b2a2-1226-48ff-a6e7-406cff243293'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'e5e6d634-7ebc-4a8f-a2ca-d5f9ac17ef06'}]} >Thread-95::DEBUG::2013-12-12 09:51:00,583::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-95::DEBUG::2013-12-12 09:51:00,753::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '638f254c-c650-409a-9ab5-6fbfe5dccb70', 'bricks': ['latest-a:/bricks/201312120949084721942637805', 'latest-a:/bricks/20131212094909398850249563', 'latest-a:/bricks/201312120949093981245056192', 'latest-b:/bricks/20131212094909398550199115', 'latest-b:/bricks/20131212094909398516730110', 'latest-b:/bricks/201312120949093981287551485', 'latest-b:/bricks/20131212094933681927299489', 'latest-a:/bricks/20131212094943396341374234', 'latest-b:/bricks/20131212094953086219930446', 'latest-a:/bricks/201312120950051631151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-98::DEBUG::2013-12-12 09:51:05,786::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-98::DEBUG::2013-12-12 09:51:06,120::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': 'eeb1b2a2-1226-48ff-a6e7-406cff243293'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'e5e6d634-7ebc-4a8f-a2ca-d5f9ac17ef06'}]} >Thread-99::DEBUG::2013-12-12 09:51:06,128::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-99::DEBUG::2013-12-12 09:51:06,296::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '638f254c-c650-409a-9ab5-6fbfe5dccb70', 'bricks': ['latest-a:/bricks/201312120949084721942637805', 'latest-a:/bricks/20131212094909398850249563', 'latest-a:/bricks/201312120949093981245056192', 'latest-b:/bricks/20131212094909398550199115', 'latest-b:/bricks/20131212094909398516730110', 'latest-b:/bricks/201312120949093981287551485', 'latest-b:/bricks/20131212094933681927299489', 'latest-a:/bricks/20131212094943396341374234', 'latest-b:/bricks/20131212094953086219930446', 'latest-a:/bricks/201312120950051631151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-101::DEBUG::2013-12-12 09:51:11,325::task::579::TaskManager.Task::(_updateState) Task=`9cba0041-9336-431e-9320-5140b71c70a1`::moving from state init -> state preparing >Thread-101::INFO::2013-12-12 09:51:11,326::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-101::INFO::2013-12-12 09:51:11,326::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-101::DEBUG::2013-12-12 09:51:11,326::task::1168::TaskManager.Task::(prepare) Task=`9cba0041-9336-431e-9320-5140b71c70a1`::finished: {} >Thread-101::DEBUG::2013-12-12 09:51:11,326::task::579::TaskManager.Task::(_updateState) Task=`9cba0041-9336-431e-9320-5140b71c70a1`::moving from state preparing -> state finished >Thread-101::DEBUG::2013-12-12 09:51:11,326::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-101::DEBUG::2013-12-12 09:51:11,326::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-101::DEBUG::2013-12-12 09:51:11,327::task::974::TaskManager.Task::(_decref) Task=`9cba0041-9336-431e-9320-5140b71c70a1`::ref 0 aborting False >Thread-104::DEBUG::2013-12-12 09:51:14,907::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeRebalanceStart with ('StartMigrationDuringRebalanceTest', False, False) {} flowID [23e28d0e] >Thread-105::DEBUG::2013-12-12 09:51:16,866::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-105::ERROR::2013-12-12 09:51:20,528::BindingXMLRPC::1000::vds::(wrapper) vdsm exception occured >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 989, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 53, in wrapper > rv = func(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 229, in hostsList > return {'hosts': self.svdsmProxy.glusterPeerStatus()} > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in glusterPeerStatus > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >GlusterCmdExecFailedException: Command execution failed >error: Connection failed. Please check if gluster daemon is operational. >peer status: failed >return code: 1 >Thread-104::ERROR::2013-12-12 09:51:20,530::BindingXMLRPC::1000::vds::(wrapper) vdsm exception occured >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 989, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 53, in wrapper > rv = func(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 125, in volumeRebalanceStart > force) > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in glusterVolumeRebalanceStart > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >GlusterCmdExecFailedException: Command execution failed >error: Connection failed. Please check if gluster daemon is operational. >return code: 1 >Thread-107::DEBUG::2013-12-12 09:51:20,549::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-107::ERROR::2013-12-12 09:51:23,561::BindingXMLRPC::1000::vds::(wrapper) vdsm exception occured >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 989, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 53, in wrapper > rv = func(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 295, in tasksList > status = self.svdsmProxy.glusterTasksList(taskIds) > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in glusterTasksList > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >GlusterCmdExecFailedException: Command execution failed >error: Connection failed. Please check if gluster daemon is operational. >return code: 1 >Thread-109::DEBUG::2013-12-12 09:51:26,547::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} flowID [24dcf4c8] >Thread-109::ERROR::2013-12-12 09:51:29,558::BindingXMLRPC::1000::vds::(wrapper) vdsm exception occured >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 989, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 53, in wrapper > rv = func(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 77, in volumesList > return {'volumes': self.svdsmProxy.glusterVolumeInfo(volumeName)} > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in glusterVolumeInfo > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >GlusterCmdExecFailedException: Command execution failed >error: Connection failed. Please check if gluster daemon is operational. >return code: 1 >Thread-111::DEBUG::2013-12-12 09:51:29,601::task::579::TaskManager.Task::(_updateState) Task=`20b295e4-716c-4bb7-b1d0-b07662cfc309`::moving from state init -> state preparing >Thread-111::INFO::2013-12-12 09:51:29,601::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-111::INFO::2013-12-12 09:51:29,601::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-111::DEBUG::2013-12-12 09:51:29,601::task::1168::TaskManager.Task::(prepare) Task=`20b295e4-716c-4bb7-b1d0-b07662cfc309`::finished: {} >Thread-111::DEBUG::2013-12-12 09:51:29,601::task::579::TaskManager.Task::(_updateState) Task=`20b295e4-716c-4bb7-b1d0-b07662cfc309`::moving from state preparing -> state finished >Thread-111::DEBUG::2013-12-12 09:51:29,602::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-111::DEBUG::2013-12-12 09:51:29,602::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-111::DEBUG::2013-12-12 09:51:29,602::task::974::TaskManager.Task::(_decref) Task=`20b295e4-716c-4bb7-b1d0-b07662cfc309`::ref 0 aborting False >Thread-117::DEBUG::2013-12-12 09:51:44,709::task::579::TaskManager.Task::(_updateState) Task=`f998dca7-23c8-4969-ad2d-63b9876857db`::moving from state init -> state preparing >Thread-117::INFO::2013-12-12 09:51:44,709::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-117::INFO::2013-12-12 09:51:44,710::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-117::DEBUG::2013-12-12 09:51:44,710::task::1168::TaskManager.Task::(prepare) Task=`f998dca7-23c8-4969-ad2d-63b9876857db`::finished: {} >Thread-117::DEBUG::2013-12-12 09:51:44,710::task::579::TaskManager.Task::(_updateState) Task=`f998dca7-23c8-4969-ad2d-63b9876857db`::moving from state preparing -> state finished >Thread-117::DEBUG::2013-12-12 09:51:44,710::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-117::DEBUG::2013-12-12 09:51:44,710::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-117::DEBUG::2013-12-12 09:51:44,710::task::974::TaskManager.Task::(_decref) Task=`f998dca7-23c8-4969-ad2d-63b9876857db`::ref 0 aborting False >Thread-123::DEBUG::2013-12-12 09:51:59,818::task::579::TaskManager.Task::(_updateState) Task=`0b1f95f8-8947-4f82-9f0d-b6c52aa50495`::moving from state init -> state preparing >Thread-123::INFO::2013-12-12 09:51:59,818::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-123::INFO::2013-12-12 09:51:59,818::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-123::DEBUG::2013-12-12 09:51:59,818::task::1168::TaskManager.Task::(prepare) Task=`0b1f95f8-8947-4f82-9f0d-b6c52aa50495`::finished: {} >Thread-123::DEBUG::2013-12-12 09:51:59,818::task::579::TaskManager.Task::(_updateState) Task=`0b1f95f8-8947-4f82-9f0d-b6c52aa50495`::moving from state preparing -> state finished >Thread-123::DEBUG::2013-12-12 09:51:59,819::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-123::DEBUG::2013-12-12 09:51:59,819::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-123::DEBUG::2013-12-12 09:51:59,819::task::974::TaskManager.Task::(_decref) Task=`0b1f95f8-8947-4f82-9f0d-b6c52aa50495`::ref 0 aborting False >Thread-129::DEBUG::2013-12-12 09:52:15,306::task::579::TaskManager.Task::(_updateState) Task=`69309ebd-196d-49af-8eee-38120e6be900`::moving from state init -> state preparing >Thread-129::INFO::2013-12-12 09:52:15,306::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-129::INFO::2013-12-12 09:52:15,306::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-129::DEBUG::2013-12-12 09:52:15,307::task::1168::TaskManager.Task::(prepare) Task=`69309ebd-196d-49af-8eee-38120e6be900`::finished: {} >Thread-129::DEBUG::2013-12-12 09:52:15,307::task::579::TaskManager.Task::(_updateState) Task=`69309ebd-196d-49af-8eee-38120e6be900`::moving from state preparing -> state finished >Thread-129::DEBUG::2013-12-12 09:52:15,307::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-129::DEBUG::2013-12-12 09:52:15,307::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-129::DEBUG::2013-12-12 09:52:15,307::task::974::TaskManager.Task::(_decref) Task=`69309ebd-196d-49af-8eee-38120e6be900`::ref 0 aborting False >Thread-135::DEBUG::2013-12-12 09:52:30,413::task::579::TaskManager.Task::(_updateState) Task=`16470e69-3c27-4b5b-ab6f-9d9a3310bbfc`::moving from state init -> state preparing >Thread-135::INFO::2013-12-12 09:52:30,413::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135::INFO::2013-12-12 09:52:30,413::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-135::DEBUG::2013-12-12 09:52:30,414::task::1168::TaskManager.Task::(prepare) Task=`16470e69-3c27-4b5b-ab6f-9d9a3310bbfc`::finished: {} >Thread-135::DEBUG::2013-12-12 09:52:30,414::task::579::TaskManager.Task::(_updateState) Task=`16470e69-3c27-4b5b-ab6f-9d9a3310bbfc`::moving from state preparing -> state finished >Thread-135::DEBUG::2013-12-12 09:52:30,414::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135::DEBUG::2013-12-12 09:52:30,414::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135::DEBUG::2013-12-12 09:52:30,414::task::974::TaskManager.Task::(_decref) Task=`16470e69-3c27-4b5b-ab6f-9d9a3310bbfc`::ref 0 aborting False >Thread-141::DEBUG::2013-12-12 09:52:45,606::task::579::TaskManager.Task::(_updateState) Task=`24cedfa5-8c12-48ad-acae-f2b136816d50`::moving from state init -> state preparing >Thread-141::INFO::2013-12-12 09:52:45,606::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-141::INFO::2013-12-12 09:52:45,606::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-141::DEBUG::2013-12-12 09:52:45,607::task::1168::TaskManager.Task::(prepare) Task=`24cedfa5-8c12-48ad-acae-f2b136816d50`::finished: {} >Thread-141::DEBUG::2013-12-12 09:52:45,607::task::579::TaskManager.Task::(_updateState) Task=`24cedfa5-8c12-48ad-acae-f2b136816d50`::moving from state preparing -> state finished >Thread-141::DEBUG::2013-12-12 09:52:45,607::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-141::DEBUG::2013-12-12 09:52:45,607::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-141::DEBUG::2013-12-12 09:52:45,607::task::974::TaskManager.Task::(_decref) Task=`24cedfa5-8c12-48ad-acae-f2b136816d50`::ref 0 aborting False >Thread-147::DEBUG::2013-12-12 09:53:00,698::task::579::TaskManager.Task::(_updateState) Task=`f707d576-dd41-435f-b621-b557a468c2c1`::moving from state init -> state preparing >Thread-147::INFO::2013-12-12 09:53:00,698::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-147::INFO::2013-12-12 09:53:00,698::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-147::DEBUG::2013-12-12 09:53:00,698::task::1168::TaskManager.Task::(prepare) Task=`f707d576-dd41-435f-b621-b557a468c2c1`::finished: {} >Thread-147::DEBUG::2013-12-12 09:53:00,698::task::579::TaskManager.Task::(_updateState) Task=`f707d576-dd41-435f-b621-b557a468c2c1`::moving from state preparing -> state finished >Thread-147::DEBUG::2013-12-12 09:53:00,699::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-147::DEBUG::2013-12-12 09:53:00,699::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-147::DEBUG::2013-12-12 09:53:00,699::task::974::TaskManager.Task::(_decref) Task=`f707d576-dd41-435f-b621-b557a468c2c1`::ref 0 aborting False >Thread-153::DEBUG::2013-12-12 09:53:15,791::task::579::TaskManager.Task::(_updateState) Task=`b480f427-7241-4727-a54f-8284f70937be`::moving from state init -> state preparing >Thread-153::INFO::2013-12-12 09:53:15,791::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-153::INFO::2013-12-12 09:53:15,791::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-153::DEBUG::2013-12-12 09:53:15,791::task::1168::TaskManager.Task::(prepare) Task=`b480f427-7241-4727-a54f-8284f70937be`::finished: {} >Thread-153::DEBUG::2013-12-12 09:53:15,791::task::579::TaskManager.Task::(_updateState) Task=`b480f427-7241-4727-a54f-8284f70937be`::moving from state preparing -> state finished >Thread-153::DEBUG::2013-12-12 09:53:15,791::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-153::DEBUG::2013-12-12 09:53:15,792::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-153::DEBUG::2013-12-12 09:53:15,792::task::974::TaskManager.Task::(_decref) Task=`b480f427-7241-4727-a54f-8284f70937be`::ref 0 aborting False >Thread-159::DEBUG::2013-12-12 09:53:30,900::task::579::TaskManager.Task::(_updateState) Task=`2e85f9d5-1f7f-4406-b809-a176645a16c2`::moving from state init -> state preparing >Thread-159::INFO::2013-12-12 09:53:30,900::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-159::INFO::2013-12-12 09:53:30,900::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-159::DEBUG::2013-12-12 09:53:30,901::task::1168::TaskManager.Task::(prepare) Task=`2e85f9d5-1f7f-4406-b809-a176645a16c2`::finished: {} >Thread-159::DEBUG::2013-12-12 09:53:30,901::task::579::TaskManager.Task::(_updateState) Task=`2e85f9d5-1f7f-4406-b809-a176645a16c2`::moving from state preparing -> state finished >Thread-159::DEBUG::2013-12-12 09:53:30,901::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-159::DEBUG::2013-12-12 09:53:30,901::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-159::DEBUG::2013-12-12 09:53:30,901::task::974::TaskManager.Task::(_decref) Task=`2e85f9d5-1f7f-4406-b809-a176645a16c2`::ref 0 aborting False >Thread-165::DEBUG::2013-12-12 09:53:45,991::task::579::TaskManager.Task::(_updateState) Task=`cdb39fdc-2c30-453e-8482-738b2e2efcd5`::moving from state init -> state preparing >Thread-165::INFO::2013-12-12 09:53:45,992::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-165::INFO::2013-12-12 09:53:45,992::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-165::DEBUG::2013-12-12 09:53:45,992::task::1168::TaskManager.Task::(prepare) Task=`cdb39fdc-2c30-453e-8482-738b2e2efcd5`::finished: {} >Thread-165::DEBUG::2013-12-12 09:53:45,992::task::579::TaskManager.Task::(_updateState) Task=`cdb39fdc-2c30-453e-8482-738b2e2efcd5`::moving from state preparing -> state finished >Thread-165::DEBUG::2013-12-12 09:53:45,992::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-165::DEBUG::2013-12-12 09:53:45,992::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-165::DEBUG::2013-12-12 09:53:45,993::task::974::TaskManager.Task::(_decref) Task=`cdb39fdc-2c30-453e-8482-738b2e2efcd5`::ref 0 aborting False >Thread-171::DEBUG::2013-12-12 09:54:01,255::task::579::TaskManager.Task::(_updateState) Task=`41c257db-2f02-4399-b883-56cc529b0de1`::moving from state init -> state preparing >Thread-171::INFO::2013-12-12 09:54:01,255::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-171::INFO::2013-12-12 09:54:01,255::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-171::DEBUG::2013-12-12 09:54:01,255::task::1168::TaskManager.Task::(prepare) Task=`41c257db-2f02-4399-b883-56cc529b0de1`::finished: {} >Thread-171::DEBUG::2013-12-12 09:54:01,256::task::579::TaskManager.Task::(_updateState) Task=`41c257db-2f02-4399-b883-56cc529b0de1`::moving from state preparing -> state finished >Thread-171::DEBUG::2013-12-12 09:54:01,256::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-171::DEBUG::2013-12-12 09:54:01,256::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-171::DEBUG::2013-12-12 09:54:01,256::task::974::TaskManager.Task::(_decref) Task=`41c257db-2f02-4399-b883-56cc529b0de1`::ref 0 aborting False >Thread-177::DEBUG::2013-12-12 09:54:16,341::task::579::TaskManager.Task::(_updateState) Task=`5ed36d22-1976-48d5-8b18-3001ee4e2467`::moving from state init -> state preparing >Thread-177::INFO::2013-12-12 09:54:16,341::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-177::INFO::2013-12-12 09:54:16,341::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-177::DEBUG::2013-12-12 09:54:16,341::task::1168::TaskManager.Task::(prepare) Task=`5ed36d22-1976-48d5-8b18-3001ee4e2467`::finished: {} >Thread-177::DEBUG::2013-12-12 09:54:16,341::task::579::TaskManager.Task::(_updateState) Task=`5ed36d22-1976-48d5-8b18-3001ee4e2467`::moving from state preparing -> state finished >Thread-177::DEBUG::2013-12-12 09:54:16,342::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-177::DEBUG::2013-12-12 09:54:16,342::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-177::DEBUG::2013-12-12 09:54:16,342::task::974::TaskManager.Task::(_decref) Task=`5ed36d22-1976-48d5-8b18-3001ee4e2467`::ref 0 aborting False >Thread-183::DEBUG::2013-12-12 09:54:31,440::task::579::TaskManager.Task::(_updateState) Task=`bee5874a-3bd2-4a65-b3bf-fa3e66a49ded`::moving from state init -> state preparing >Thread-183::INFO::2013-12-12 09:54:31,440::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-183::INFO::2013-12-12 09:54:31,440::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-183::DEBUG::2013-12-12 09:54:31,440::task::1168::TaskManager.Task::(prepare) Task=`bee5874a-3bd2-4a65-b3bf-fa3e66a49ded`::finished: {} >Thread-183::DEBUG::2013-12-12 09:54:31,440::task::579::TaskManager.Task::(_updateState) Task=`bee5874a-3bd2-4a65-b3bf-fa3e66a49ded`::moving from state preparing -> state finished >Thread-183::DEBUG::2013-12-12 09:54:31,441::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-183::DEBUG::2013-12-12 09:54:31,441::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-183::DEBUG::2013-12-12 09:54:31,441::task::974::TaskManager.Task::(_decref) Task=`bee5874a-3bd2-4a65-b3bf-fa3e66a49ded`::ref 0 aborting False >Thread-189::DEBUG::2013-12-12 09:54:46,530::task::579::TaskManager.Task::(_updateState) Task=`d5da023e-1713-4f19-93e6-41cb3ca50bc0`::moving from state init -> state preparing >Thread-189::INFO::2013-12-12 09:54:46,530::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-189::INFO::2013-12-12 09:54:46,530::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-189::DEBUG::2013-12-12 09:54:46,530::task::1168::TaskManager.Task::(prepare) Task=`d5da023e-1713-4f19-93e6-41cb3ca50bc0`::finished: {} >Thread-189::DEBUG::2013-12-12 09:54:46,530::task::579::TaskManager.Task::(_updateState) Task=`d5da023e-1713-4f19-93e6-41cb3ca50bc0`::moving from state preparing -> state finished >Thread-189::DEBUG::2013-12-12 09:54:46,531::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189::DEBUG::2013-12-12 09:54:46,531::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189::DEBUG::2013-12-12 09:54:46,531::task::974::TaskManager.Task::(_decref) Task=`d5da023e-1713-4f19-93e6-41cb3ca50bc0`::ref 0 aborting False >Thread-195::DEBUG::2013-12-12 09:55:01,337::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getCapabilities with () {} flowID [61ceb86f] >Thread-195::DEBUG::2013-12-12 09:55:01,337::utils::489::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-195::DEBUG::2013-12-12 09:55:01,343::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-195::DEBUG::2013-12-12 09:55:01,354::caps::363::root::(_getKeyPackages) rpm package glusterfs-rdma not found >Thread-195::DEBUG::2013-12-12 09:55:01,355::caps::363::root::(_getKeyPackages) rpm package glusterfs-fuse not found >Thread-195::DEBUG::2013-12-12 09:55:01,355::caps::363::root::(_getKeyPackages) rpm package gluster-swift not found >Thread-195::DEBUG::2013-12-12 09:55:01,356::caps::363::root::(_getKeyPackages) rpm package qemu-kvm-rhev not found >Thread-195::DEBUG::2013-12-12 09:55:01,356::caps::363::root::(_getKeyPackages) rpm package gluster-swift-object not found >Thread-195::DEBUG::2013-12-12 09:55:01,356::caps::363::root::(_getKeyPackages) rpm package glusterfs not found >Thread-195::DEBUG::2013-12-12 09:55:01,357::caps::363::root::(_getKeyPackages) rpm package gluster-swift-plugin not found >Thread-195::DEBUG::2013-12-12 09:55:01,358::caps::363::root::(_getKeyPackages) rpm package qemu-img-rhev not found >Thread-195::DEBUG::2013-12-12 09:55:01,358::caps::363::root::(_getKeyPackages) rpm package ('mom',) not found >Thread-195::DEBUG::2013-12-12 09:55:01,359::caps::363::root::(_getKeyPackages) rpm package gluster-swift-account not found >Thread-195::DEBUG::2013-12-12 09:55:01,359::caps::363::root::(_getKeyPackages) rpm package gluster-swift-proxy not found >Thread-195::DEBUG::2013-12-12 09:55:01,359::caps::363::root::(_getKeyPackages) rpm package gluster-swift-doc not found >Thread-195::DEBUG::2013-12-12 09:55:01,359::caps::363::root::(_getKeyPackages) rpm package glusterfs-server not found >Thread-195::DEBUG::2013-12-12 09:55:01,360::caps::363::root::(_getKeyPackages) rpm package gluster-swift-container not found >Thread-195::DEBUG::2013-12-12 09:55:01,360::caps::363::root::(_getKeyPackages) rpm package glusterfs-geo-replication not found >Thread-195::DEBUG::2013-12-12 09:55:01,361::BindingXMLRPC::991::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.28.1.el6.x86_64', 'buildtime': 1384533955.0, 'version': '2.6.32'}, 'vdsm': {'release': '23.1.el6rhs', 'buildtime': 1386773756L, 'version': '4.13.0'}, 'spice-server': {'release': '12.el6_4.5', 'buildtime': 1381834662L, 'version': '0.12.0'}, 'libvirt': {'release': '18.el6_4.13', 'buildtime': 1379320058L, 'version': '0.10.2'}}, 'cpuModel': 'QEMU Virtual CPU version 1.4.2', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.14.16.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.14.16.254', 'ports': ['eth0']}}, 'uuid': '7B904C94-94EE-7B49-40B3-BD3C28FBB749', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'netmask': '', 'addr': '', 'hwaddr': '52:54:00:b7:60:bc', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': '52:54:00:b7:60:bc', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 100, 'mtu': '1500'}}, 'software_revision': '23.1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': 'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,lm,up,rep_good,unfair_spinlock,pni,cx16,popcnt,hypervisor,lahf_lm', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '4062', 'cpuSpeed': '2393.998', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '1', 'kvmEnabled': 'false', 'rhsVersion': {'release': '1.el6rhs', 'version': '2.1.2.0', 'name': 'RHS'}, 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '1', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.14.16.112'}} >Thread-196::DEBUG::2013-12-12 09:55:01,377::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getHardwareInfo with () {} flowID [61ceb86f] >Thread-196::DEBUG::2013-12-12 09:55:01,379::BindingXMLRPC::991::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'Bochs', 'systemSerialNumber': 'Not Specified', 'systemFamily': 'Not Specified', 'systemVersion': 'Not Specified', 'systemUUID': '7b904c94-94ee-7b49-40b3-bd3c28fbb749', 'systemManufacturer': 'Bochs'}} >Thread-197::DEBUG::2013-12-12 09:55:01,395::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} flowID [61ceb86f] >Thread-197::DEBUG::2013-12-12 09:55:01,962::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}]} >Thread-198::DEBUG::2013-12-12 09:55:04,630::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getCapabilities with () {} >Thread-198::DEBUG::2013-12-12 09:55:04,631::utils::489::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-198::DEBUG::2013-12-12 09:55:04,636::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-198::DEBUG::2013-12-12 09:55:04,649::caps::363::root::(_getKeyPackages) rpm package glusterfs-rdma not found >Thread-198::DEBUG::2013-12-12 09:55:04,649::caps::363::root::(_getKeyPackages) rpm package glusterfs-fuse not found >Thread-198::DEBUG::2013-12-12 09:55:04,650::caps::363::root::(_getKeyPackages) rpm package gluster-swift not found >Thread-198::DEBUG::2013-12-12 09:55:04,651::caps::363::root::(_getKeyPackages) rpm package qemu-kvm-rhev not found >Thread-198::DEBUG::2013-12-12 09:55:04,651::caps::363::root::(_getKeyPackages) rpm package gluster-swift-object not found >Thread-198::DEBUG::2013-12-12 09:55:04,651::caps::363::root::(_getKeyPackages) rpm package glusterfs not found >Thread-198::DEBUG::2013-12-12 09:55:04,652::caps::363::root::(_getKeyPackages) rpm package gluster-swift-plugin not found >Thread-198::DEBUG::2013-12-12 09:55:04,653::caps::363::root::(_getKeyPackages) rpm package qemu-img-rhev not found >Thread-198::DEBUG::2013-12-12 09:55:04,653::caps::363::root::(_getKeyPackages) rpm package ('mom',) not found >Thread-198::DEBUG::2013-12-12 09:55:04,654::caps::363::root::(_getKeyPackages) rpm package gluster-swift-account not found >Thread-198::DEBUG::2013-12-12 09:55:04,654::caps::363::root::(_getKeyPackages) rpm package gluster-swift-proxy not found >Thread-198::DEBUG::2013-12-12 09:55:04,654::caps::363::root::(_getKeyPackages) rpm package gluster-swift-doc not found >Thread-198::DEBUG::2013-12-12 09:55:04,654::caps::363::root::(_getKeyPackages) rpm package glusterfs-server not found >Thread-198::DEBUG::2013-12-12 09:55:04,655::caps::363::root::(_getKeyPackages) rpm package gluster-swift-container not found >Thread-198::DEBUG::2013-12-12 09:55:04,655::caps::363::root::(_getKeyPackages) rpm package glusterfs-geo-replication not found >Thread-198::DEBUG::2013-12-12 09:55:04,656::BindingXMLRPC::991::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.28.1.el6.x86_64', 'buildtime': 1384533955.0, 'version': '2.6.32'}, 'vdsm': {'release': '23.1.el6rhs', 'buildtime': 1386773756L, 'version': '4.13.0'}, 'spice-server': {'release': '12.el6_4.5', 'buildtime': 1381834662L, 'version': '0.12.0'}, 'libvirt': {'release': '18.el6_4.13', 'buildtime': 1379320058L, 'version': '0.10.2'}}, 'cpuModel': 'QEMU Virtual CPU version 1.4.2', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.14.16.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.14.16.254', 'ports': ['eth0']}}, 'uuid': '7B904C94-94EE-7B49-40B3-BD3C28FBB749', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'netmask': '', 'addr': '', 'hwaddr': '52:54:00:b7:60:bc', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': '52:54:00:b7:60:bc', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 100, 'mtu': '1500'}}, 'software_revision': '23.1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': 'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,lm,up,rep_good,unfair_spinlock,pni,cx16,popcnt,hypervisor,lahf_lm', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '4062', 'cpuSpeed': '2393.998', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '1', 'kvmEnabled': 'false', 'rhsVersion': {'release': '1.el6rhs', 'version': '2.1.2.0', 'name': 'RHS'}, 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '1', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.14.16.112'}} >Thread-199::DEBUG::2013-12-12 09:55:04,667::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getHardwareInfo with () {} >Thread-199::DEBUG::2013-12-12 09:55:04,669::BindingXMLRPC::991::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'Bochs', 'systemSerialNumber': 'Not Specified', 'systemFamily': 'Not Specified', 'systemVersion': 'Not Specified', 'systemUUID': '7b904c94-94ee-7b49-40b3-bd3c28fbb749', 'systemManufacturer': 'Bochs'}} >Thread-200::DEBUG::2013-12-12 09:55:04,686::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-200::DEBUG::2013-12-12 09:55:05,020::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}]} >Thread-202::DEBUG::2013-12-12 09:55:05,043::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostUUIDGet with () {} flowID [16a0ca42] >Thread-202::DEBUG::2013-12-12 09:55:05,215::BindingXMLRPC::991::vds::(wrapper) return hostUUIDGet with {'status': {'message': 'Done', 'code': 0}, 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'} >Thread-203::DEBUG::2013-12-12 09:55:08,356::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-203::DEBUG::2013-12-12 09:55:08,784::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >MainThread::DEBUG::2013-12-12 10:21:20,074::vdsm::45::vds::(sigtermHandler) Received signal 15 >MainThread::INFO::2013-12-12 10:21:20,106::vmChannels::183::vds::(stop) VM channels listener was stopped. >MainThread::DEBUG::2013-12-12 10:21:20,106::task::579::TaskManager.Task::(_updateState) Task=`dc4f3174-2b47-45fe-ae71-a86710069207`::moving from state init -> state preparing >MainThread::INFO::2013-12-12 10:21:20,106::logUtils::44::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2013-12-12 10:21:20,132::storageServer::698::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::INFO::2013-12-12 10:21:20,411::domainMonitor::126::Storage.DomainMonitor::(close) Stopping domain monitors >MainThread::DEBUG::2013-12-12 10:21:20,411::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2013-12-12 10:21:20,412::logUtils::47::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2013-12-12 10:21:20,412::task::1168::TaskManager.Task::(prepare) Task=`dc4f3174-2b47-45fe-ae71-a86710069207`::finished: None >MainThread::DEBUG::2013-12-12 10:21:20,412::task::579::TaskManager.Task::(_updateState) Task=`dc4f3174-2b47-45fe-ae71-a86710069207`::moving from state preparing -> state finished >MainThread::DEBUG::2013-12-12 10:21:20,412::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-12-12 10:21:20,412::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-12-12 10:21:20,412::task::974::TaskManager.Task::(_decref) Task=`dc4f3174-2b47-45fe-ae71-a86710069207`::ref 0 aborting False >MainThread::INFO::2013-12-12 10:21:20,413::vdsm::107::vds::(run) VDSM main thread ended. Waiting for 13 other threads... >MainThread::INFO::2013-12-12 10:21:20,413::vdsm::111::vds::(run) <_MainThread(MainThread, started 139727058278144)> >MainThread::INFO::2013-12-12 10:21:20,413::vdsm::111::vds::(run) <Thread(libvirtEventLoop, started daemon 139726838200064)> >MainThread::INFO::2013-12-12 10:21:20,413::vdsm::111::vds::(run) <WorkerThread(Thread-6, started daemon 139726652684032)> >MainThread::INFO::2013-12-12 10:21:20,413::vdsm::111::vds::(run) <KsmMonitorThread(KsmMonitor, started daemon 139726090663680)> >MainThread::INFO::2013-12-12 10:21:20,413::vdsm::111::vds::(run) <WorkerThread(Thread-5, started daemon 139726663173888)> >MainThread::INFO::2013-12-12 10:21:20,414::vdsm::111::vds::(run) <WorkerThread(Thread-8, started daemon 139726224881408)> >MainThread::INFO::2013-12-12 10:21:20,414::vdsm::111::vds::(run) <WorkerThread(Thread-4, started daemon 139726673663744)> >MainThread::INFO::2013-12-12 10:21:20,414::vdsm::111::vds::(run) <WorkerThread(Thread-7, started daemon 139726642194176)> >MainThread::INFO::2013-12-12 10:21:20,414::vdsm::111::vds::(run) <WorkerThread(Thread-9, started daemon 139726214391552)> >MainThread::INFO::2013-12-12 10:21:20,414::vdsm::111::vds::(run) <WorkerThread(Thread-2, started daemon 139726694643456)> >MainThread::INFO::2013-12-12 10:21:20,414::vdsm::111::vds::(run) <WorkerThread(Thread-1, started daemon 139726776174336)> >MainThread::INFO::2013-12-12 10:21:20,414::vmChannels::183::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2013-12-12 10:21:20,415::vdsm::111::vds::(run) <Listener(VM Channels Listener, started daemon 139726069683968)> >MainThread::INFO::2013-12-12 10:21:20,415::vdsm::111::vds::(run) <WorkerThread(Thread-10, started daemon 139726203901696)> >MainThread::INFO::2013-12-12 10:21:20,415::vdsm::111::vds::(run) <WorkerThread(Thread-3, started daemon 139726684153600)> >MainThread::INFO::2013-12-12 10:21:35,228::vdsm::101::vds::(run) (PID: 9387) I am the actual vdsm 4.13.0-23.1.el6rhs rhs-21u2-20131208-b (2.6.32-358.28.1.el6.x86_64) >MainThread::DEBUG::2013-12-12 10:21:35,481::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2013-12-12 10:21:35,481::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2013-12-12 10:21:35,486::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2013-12-12 10:21:36,051::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::INFO::2013-12-12 10:21:36,085::multipath::134::Storage.Multipath::(isEnabled) Manual override for multipath.conf detected - preserving current configuration >MainThread::WARNING::2013-12-12 10:21:36,086::multipath::137::Storage.Multipath::(isEnabled) This manual override for multipath.conf was based on downrevved template. You are strongly advised to contact your support representatives >MainThread::DEBUG::2013-12-12 10:21:36,086::hsm::426::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2013-12-12 10:21:36,120::hsm::426::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-12-12 10:21:36,120::hsm::450::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2013-12-12 10:21:36,122::hsm::482::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2013-12-12 10:21:36,123::hsm::483::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2013-12-12 10:21:36,123::hsm::485::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2013-12-12 10:21:36,124::hsm::528::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2013-12-12 10:21:36,126::dispatcher::98::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >MainThread::DEBUG::2013-12-12 10:21:36,127::task::579::TaskManager.Task::(_updateState) Task=`0fa62bdb-8d0c-4179-9953-8a5c114c88f5`::moving from state init -> state preparing >MainThread::INFO::2013-12-12 10:21:36,127::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0x7f326eacb200>>) >MainThread::INFO::2013-12-12 10:21:36,127::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None >MainThread::DEBUG::2013-12-12 10:21:36,127::task::1168::TaskManager.Task::(prepare) Task=`0fa62bdb-8d0c-4179-9953-8a5c114c88f5`::finished: None >MainThread::DEBUG::2013-12-12 10:21:36,128::task::579::TaskManager.Task::(_updateState) Task=`0fa62bdb-8d0c-4179-9953-8a5c114c88f5`::moving from state preparing -> state finished >MainThread::DEBUG::2013-12-12 10:21:36,128::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-12-12 10:21:36,128::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-12-12 10:21:36,128::task::974::TaskManager.Task::(_decref) Task=`0fa62bdb-8d0c-4179-9953-8a5c114c88f5`::ref 0 aborting False >storageRefresh::DEBUG::2013-12-12 10:21:36,132::lvm::338::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 10:21:36,133::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::WARNING::2013-12-12 10:21:36,142::clientIF::196::vds::(_prepareMOM) MOM is not available, fallback to KsmMonitor >MainThread::DEBUG::2013-12-12 10:21:36,142::utils::489::root::(execCmd) '/usr/bin/pgrep -xf ksmd' (cwd None) >MainThread::DEBUG::2013-12-12 10:21:36,168::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2013-12-12 10:21:36,168::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 29 >storageRefresh::DEBUG::2013-12-12 10:21:36,200::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 10:21:36,200::lvm::363::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 10:21:36,200::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 10:21:36,201::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >KsmMonitor::DEBUG::2013-12-12 10:21:36,210::utils::489::root::(execCmd) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2013-12-12 10:21:36,218::vmChannels::187::vds::(settimeout) Setting channels' timeout to 30 seconds. >clientIFinit::DEBUG::2013-12-12 10:21:36,219::libvirtconnection::131::libvirtconnection::(get) trying to connect libvirt >storageRefresh::DEBUG::2013-12-12 10:21:36,234::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 10:21:36,235::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 10:21:36,236::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >VM Channels Listener::INFO::2013-12-12 10:21:36,255::vmChannels::170::vds::(run) Starting VM channels listener thread. >storageRefresh::DEBUG::2013-12-12 10:21:36,284::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 10:21:36,284::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 10:21:36,285::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >storageRefresh::DEBUG::2013-12-12 10:21:36,330::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 10:21:36,330::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 10:21:36,331::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >storageRefresh::DEBUG::2013-12-12 10:21:36,331::misc::811::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-12-12 10:21:36,331::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2013-12-12 10:21:36,331::misc::811::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-12-12 10:21:36,331::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2013-12-12 10:21:36,371::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >storageRefresh::DEBUG::2013-12-12 10:21:36,371::misc::819::SamplingMethod::(__call__) Returning last result >Thread-13::DEBUG::2013-12-12 10:21:36,899::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call ping with () {} flowID [3b692e24] >Thread-13::DEBUG::2013-12-12 10:21:36,899::BindingXMLRPC::991::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-14::DEBUG::2013-12-12 10:21:36,936::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getCapabilities with () {} flowID [3b692e24] >Thread-14::DEBUG::2013-12-12 10:21:37,004::utils::489::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-14::DEBUG::2013-12-12 10:21:37,052::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2013-12-12 10:21:37,077::caps::363::root::(_getKeyPackages) rpm package glusterfs-rdma not found >Thread-14::DEBUG::2013-12-12 10:21:37,077::caps::363::root::(_getKeyPackages) rpm package glusterfs-fuse not found >Thread-14::DEBUG::2013-12-12 10:21:37,078::caps::363::root::(_getKeyPackages) rpm package gluster-swift not found >Thread-14::DEBUG::2013-12-12 10:21:37,078::caps::363::root::(_getKeyPackages) rpm package qemu-kvm-rhev not found >Thread-14::DEBUG::2013-12-12 10:21:37,079::caps::363::root::(_getKeyPackages) rpm package gluster-swift-object not found >Thread-14::DEBUG::2013-12-12 10:21:37,079::caps::363::root::(_getKeyPackages) rpm package glusterfs not found >Thread-14::DEBUG::2013-12-12 10:21:37,079::caps::363::root::(_getKeyPackages) rpm package gluster-swift-plugin not found >Thread-14::DEBUG::2013-12-12 10:21:37,081::caps::363::root::(_getKeyPackages) rpm package qemu-img-rhev not found >Thread-14::DEBUG::2013-12-12 10:21:37,081::caps::363::root::(_getKeyPackages) rpm package ('mom',) not found >Thread-14::DEBUG::2013-12-12 10:21:37,081::caps::363::root::(_getKeyPackages) rpm package gluster-swift-account not found >Thread-14::DEBUG::2013-12-12 10:21:37,081::caps::363::root::(_getKeyPackages) rpm package gluster-swift-proxy not found >Thread-14::DEBUG::2013-12-12 10:21:37,082::caps::363::root::(_getKeyPackages) rpm package gluster-swift-doc not found >Thread-14::DEBUG::2013-12-12 10:21:37,082::caps::363::root::(_getKeyPackages) rpm package glusterfs-server not found >Thread-14::DEBUG::2013-12-12 10:21:37,082::caps::363::root::(_getKeyPackages) rpm package gluster-swift-container not found >Thread-14::DEBUG::2013-12-12 10:21:37,083::caps::363::root::(_getKeyPackages) rpm package glusterfs-geo-replication not found >Thread-14::DEBUG::2013-12-12 10:21:37,086::BindingXMLRPC::991::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.28.1.el6.x86_64', 'buildtime': 1384533955.0, 'version': '2.6.32'}, 'vdsm': {'release': '23.1.el6rhs', 'buildtime': 1386773756L, 'version': '4.13.0'}, 'spice-server': {'release': '12.el6_4.5', 'buildtime': 1381834662L, 'version': '0.12.0'}, 'libvirt': {'release': '18.el6_4.13', 'buildtime': 1379320058L, 'version': '0.10.2'}}, 'cpuModel': 'QEMU Virtual CPU version 1.4.2', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.14.16.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.14.16.254', 'ports': ['eth0']}}, 'uuid': '7B904C94-94EE-7B49-40B3-BD3C28FBB749', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'netmask': '', 'addr': '', 'hwaddr': '52:54:00:b7:60:bc', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': '52:54:00:b7:60:bc', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 100, 'mtu': '1500'}}, 'software_revision': '23.1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': 'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,lm,up,rep_good,unfair_spinlock,pni,cx16,popcnt,hypervisor,lahf_lm', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '4062', 'cpuSpeed': '2393.998', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '1', 'kvmEnabled': 'false', 'rhsVersion': {'release': '1.el6rhs', 'version': '2.1.2.0', 'name': 'RHS'}, 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '1', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.14.16.112'}} >Thread-15::DEBUG::2013-12-12 10:21:38,105::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getCapabilities with () {} >Thread-15::DEBUG::2013-12-12 10:21:38,106::utils::489::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-15::DEBUG::2013-12-12 10:21:38,111::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2013-12-12 10:21:38,123::caps::363::root::(_getKeyPackages) rpm package glusterfs-rdma not found >Thread-15::DEBUG::2013-12-12 10:21:38,123::caps::363::root::(_getKeyPackages) rpm package glusterfs-fuse not found >Thread-15::DEBUG::2013-12-12 10:21:38,123::caps::363::root::(_getKeyPackages) rpm package gluster-swift not found >Thread-15::DEBUG::2013-12-12 10:21:38,124::caps::363::root::(_getKeyPackages) rpm package qemu-kvm-rhev not found >Thread-15::DEBUG::2013-12-12 10:21:38,125::caps::363::root::(_getKeyPackages) rpm package gluster-swift-object not found >Thread-15::DEBUG::2013-12-12 10:21:38,125::caps::363::root::(_getKeyPackages) rpm package glusterfs not found >Thread-15::DEBUG::2013-12-12 10:21:38,125::caps::363::root::(_getKeyPackages) rpm package gluster-swift-plugin not found >Thread-15::DEBUG::2013-12-12 10:21:38,127::caps::363::root::(_getKeyPackages) rpm package qemu-img-rhev not found >Thread-15::DEBUG::2013-12-12 10:21:38,127::caps::363::root::(_getKeyPackages) rpm package ('mom',) not found >Thread-15::DEBUG::2013-12-12 10:21:38,127::caps::363::root::(_getKeyPackages) rpm package gluster-swift-account not found >Thread-15::DEBUG::2013-12-12 10:21:38,128::caps::363::root::(_getKeyPackages) rpm package gluster-swift-proxy not found >Thread-15::DEBUG::2013-12-12 10:21:38,128::caps::363::root::(_getKeyPackages) rpm package gluster-swift-doc not found >Thread-15::DEBUG::2013-12-12 10:21:38,128::caps::363::root::(_getKeyPackages) rpm package glusterfs-server not found >Thread-15::DEBUG::2013-12-12 10:21:38,129::caps::363::root::(_getKeyPackages) rpm package gluster-swift-container not found >Thread-15::DEBUG::2013-12-12 10:21:38,129::caps::363::root::(_getKeyPackages) rpm package glusterfs-geo-replication not found >Thread-15::DEBUG::2013-12-12 10:21:38,130::BindingXMLRPC::991::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.28.1.el6.x86_64', 'buildtime': 1384533955.0, 'version': '2.6.32'}, 'vdsm': {'release': '23.1.el6rhs', 'buildtime': 1386773756L, 'version': '4.13.0'}, 'spice-server': {'release': '12.el6_4.5', 'buildtime': 1381834662L, 'version': '0.12.0'}, 'libvirt': {'release': '18.el6_4.13', 'buildtime': 1379320058L, 'version': '0.10.2'}}, 'cpuModel': 'QEMU Virtual CPU version 1.4.2', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.14.16.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.14.16.254', 'ports': ['eth0']}}, 'uuid': '7B904C94-94EE-7B49-40B3-BD3C28FBB749', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'netmask': '', 'addr': '', 'hwaddr': '52:54:00:b7:60:bc', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': '52:54:00:b7:60:bc', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 100, 'mtu': '1500'}}, 'software_revision': '23.1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': 'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,lm,up,rep_good,unfair_spinlock,pni,cx16,popcnt,hypervisor,lahf_lm', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '4062', 'cpuSpeed': '2393.998', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '1', 'kvmEnabled': 'false', 'rhsVersion': {'release': '1.el6rhs', 'version': '2.1.2.0', 'name': 'RHS'}, 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '1', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.14.16.112'}} >Thread-16::DEBUG::2013-12-12 10:21:38,159::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getHardwareInfo with () {} >Thread-16::DEBUG::2013-12-12 10:21:38,183::BindingXMLRPC::991::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'Bochs', 'systemSerialNumber': 'Not Specified', 'systemFamily': 'Not Specified', 'systemVersion': 'Not Specified', 'systemUUID': '7b904c94-94ee-7b49-40b3-bd3c28fbb749', 'systemManufacturer': 'Bochs'}} >Thread-17::DEBUG::2013-12-12 10:21:38,212::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-17::DEBUG::2013-12-12 10:21:38,547::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-18::DEBUG::2013-12-12 10:21:38,556::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getCapabilities with () {} >Thread-18::DEBUG::2013-12-12 10:21:38,556::utils::489::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-18::DEBUG::2013-12-12 10:21:38,562::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2013-12-12 10:21:38,574::caps::363::root::(_getKeyPackages) rpm package glusterfs-rdma not found >Thread-18::DEBUG::2013-12-12 10:21:38,574::caps::363::root::(_getKeyPackages) rpm package glusterfs-fuse not found >Thread-18::DEBUG::2013-12-12 10:21:38,575::caps::363::root::(_getKeyPackages) rpm package gluster-swift not found >Thread-18::DEBUG::2013-12-12 10:21:38,576::caps::363::root::(_getKeyPackages) rpm package qemu-kvm-rhev not found >Thread-18::DEBUG::2013-12-12 10:21:38,576::caps::363::root::(_getKeyPackages) rpm package gluster-swift-object not found >Thread-18::DEBUG::2013-12-12 10:21:38,576::caps::363::root::(_getKeyPackages) rpm package glusterfs not found >Thread-18::DEBUG::2013-12-12 10:21:38,576::caps::363::root::(_getKeyPackages) rpm package gluster-swift-plugin not found >Thread-18::DEBUG::2013-12-12 10:21:38,578::caps::363::root::(_getKeyPackages) rpm package qemu-img-rhev not found >Thread-18::DEBUG::2013-12-12 10:21:38,578::caps::363::root::(_getKeyPackages) rpm package ('mom',) not found >Thread-18::DEBUG::2013-12-12 10:21:38,578::caps::363::root::(_getKeyPackages) rpm package gluster-swift-account not found >Thread-18::DEBUG::2013-12-12 10:21:38,579::caps::363::root::(_getKeyPackages) rpm package gluster-swift-proxy not found >Thread-18::DEBUG::2013-12-12 10:21:38,579::caps::363::root::(_getKeyPackages) rpm package gluster-swift-doc not found >Thread-18::DEBUG::2013-12-12 10:21:38,579::caps::363::root::(_getKeyPackages) rpm package glusterfs-server not found >Thread-18::DEBUG::2013-12-12 10:21:38,580::caps::363::root::(_getKeyPackages) rpm package gluster-swift-container not found >Thread-18::DEBUG::2013-12-12 10:21:38,580::caps::363::root::(_getKeyPackages) rpm package glusterfs-geo-replication not found >Thread-18::DEBUG::2013-12-12 10:21:38,581::BindingXMLRPC::991::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.28.1.el6.x86_64', 'buildtime': 1384533955.0, 'version': '2.6.32'}, 'vdsm': {'release': '23.1.el6rhs', 'buildtime': 1386773756L, 'version': '4.13.0'}, 'spice-server': {'release': '12.el6_4.5', 'buildtime': 1381834662L, 'version': '0.12.0'}, 'libvirt': {'release': '18.el6_4.13', 'buildtime': 1379320058L, 'version': '0.10.2'}}, 'cpuModel': 'QEMU Virtual CPU version 1.4.2', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.14.16.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.14.16.254', 'ports': ['eth0']}}, 'uuid': '7B904C94-94EE-7B49-40B3-BD3C28FBB749', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'netmask': '', 'addr': '', 'hwaddr': '52:54:00:b7:60:bc', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': '52:54:00:b7:60:bc', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 100, 'mtu': '1500'}}, 'software_revision': '23.1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': 'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,lm,up,rep_good,unfair_spinlock,pni,cx16,popcnt,hypervisor,lahf_lm', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '4062', 'cpuSpeed': '2393.998', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '1', 'kvmEnabled': 'false', 'rhsVersion': {'release': '1.el6rhs', 'version': '2.1.2.0', 'name': 'RHS'}, 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '1', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.14.16.112'}} >Thread-19::DEBUG::2013-12-12 10:21:38,598::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getHardwareInfo with () {} >Thread-19::DEBUG::2013-12-12 10:21:38,600::BindingXMLRPC::991::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'Bochs', 'systemSerialNumber': 'Not Specified', 'systemFamily': 'Not Specified', 'systemVersion': 'Not Specified', 'systemUUID': '7b904c94-94ee-7b49-40b3-bd3c28fbb749', 'systemManufacturer': 'Bochs'}} >Thread-20::DEBUG::2013-12-12 10:21:38,629::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-20::DEBUG::2013-12-12 10:21:38,957::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-22::DEBUG::2013-12-12 10:21:38,990::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostUUIDGet with () {} flowID [16b4803b] >Thread-22::DEBUG::2013-12-12 10:21:39,156::BindingXMLRPC::991::vds::(wrapper) return hostUUIDGet with {'status': {'message': 'Done', 'code': 0}, 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'} >storageRefresh::DEBUG::2013-12-12 10:21:40,416::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >storageRefresh::DEBUG::2013-12-12 10:21:40,448::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 10:21:40,448::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 10:21:40,449::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 10:21:40,449::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 10:21:40,449::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 10:21:40,449::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 10:21:40,450::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 10:21:40,450::misc::819::SamplingMethod::(__call__) Returning last result >storageRefresh::WARNING::2013-12-12 10:21:40,450::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >KsmMonitor::DEBUG::2013-12-12 10:21:42,404::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2013-12-12 10:21:42,404::utils::489::root::(execCmd) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2013-12-12 10:21:42,451::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-24::DEBUG::2013-12-12 10:21:45,272::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-24::DEBUG::2013-12-12 10:21:45,611::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-26::DEBUG::2013-12-12 10:21:45,623::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-26::DEBUG::2013-12-12 10:21:45,789::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-28::DEBUG::2013-12-12 10:21:51,593::task::579::TaskManager.Task::(_updateState) Task=`d4fff4a2-f53b-474f-8254-b968402b80a1`::moving from state init -> state preparing >Thread-28::INFO::2013-12-12 10:21:51,594::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-28::INFO::2013-12-12 10:21:51,594::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-28::DEBUG::2013-12-12 10:21:51,594::task::1168::TaskManager.Task::(prepare) Task=`d4fff4a2-f53b-474f-8254-b968402b80a1`::finished: {} >Thread-28::DEBUG::2013-12-12 10:21:51,594::task::579::TaskManager.Task::(_updateState) Task=`d4fff4a2-f53b-474f-8254-b968402b80a1`::moving from state preparing -> state finished >Thread-28::DEBUG::2013-12-12 10:21:51,594::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2013-12-12 10:21:51,595::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2013-12-12 10:21:51,595::task::974::TaskManager.Task::(_decref) Task=`d4fff4a2-f53b-474f-8254-b968402b80a1`::ref 0 aborting False >Thread-31::DEBUG::2013-12-12 10:21:56,344::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-31::DEBUG::2013-12-12 10:21:56,684::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-32::DEBUG::2013-12-12 10:21:56,697::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-32::DEBUG::2013-12-12 10:21:56,862::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-36::DEBUG::2013-12-12 10:22:06,748::task::579::TaskManager.Task::(_updateState) Task=`a05ffa0d-7be8-414a-a80f-c07d0fb1fa03`::moving from state init -> state preparing >Thread-36::INFO::2013-12-12 10:22:06,749::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-36::INFO::2013-12-12 10:22:06,749::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-36::DEBUG::2013-12-12 10:22:06,749::task::1168::TaskManager.Task::(prepare) Task=`a05ffa0d-7be8-414a-a80f-c07d0fb1fa03`::finished: {} >Thread-36::DEBUG::2013-12-12 10:22:06,749::task::579::TaskManager.Task::(_updateState) Task=`a05ffa0d-7be8-414a-a80f-c07d0fb1fa03`::moving from state preparing -> state finished >Thread-36::DEBUG::2013-12-12 10:22:06,749::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-36::DEBUG::2013-12-12 10:22:06,749::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-36::DEBUG::2013-12-12 10:22:06,750::task::974::TaskManager.Task::(_decref) Task=`a05ffa0d-7be8-414a-a80f-c07d0fb1fa03`::ref 0 aborting False >Thread-38::DEBUG::2013-12-12 10:22:07,429::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-38::DEBUG::2013-12-12 10:22:07,761::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-39::DEBUG::2013-12-12 10:22:07,772::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-39::DEBUG::2013-12-12 10:22:07,938::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-42::DEBUG::2013-12-12 10:22:12,952::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-42::DEBUG::2013-12-12 10:22:13,285::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-43::DEBUG::2013-12-12 10:22:13,296::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-43::DEBUG::2013-12-12 10:22:13,466::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-45::DEBUG::2013-12-12 10:22:18,478::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} flowID [4145eac5] >Thread-45::DEBUG::2013-12-12 10:22:18,809::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-46::DEBUG::2013-12-12 10:22:18,821::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} flowID [4145eac5] >Thread-46::DEBUG::2013-12-12 10:22:18,990::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-48::DEBUG::2013-12-12 10:22:21,869::task::579::TaskManager.Task::(_updateState) Task=`32882dc0-c906-4703-9e90-9f385f5d49bb`::moving from state init -> state preparing >Thread-48::INFO::2013-12-12 10:22:21,870::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-48::INFO::2013-12-12 10:22:21,870::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-48::DEBUG::2013-12-12 10:22:21,870::task::1168::TaskManager.Task::(prepare) Task=`32882dc0-c906-4703-9e90-9f385f5d49bb`::finished: {} >Thread-48::DEBUG::2013-12-12 10:22:21,870::task::579::TaskManager.Task::(_updateState) Task=`32882dc0-c906-4703-9e90-9f385f5d49bb`::moving from state preparing -> state finished >Thread-48::DEBUG::2013-12-12 10:22:21,870::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2013-12-12 10:22:21,871::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2013-12-12 10:22:21,871::task::974::TaskManager.Task::(_decref) Task=`32882dc0-c906-4703-9e90-9f385f5d49bb`::ref 0 aborting False >Thread-50::DEBUG::2013-12-12 10:22:24,006::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-50::DEBUG::2013-12-12 10:22:24,341::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-51::DEBUG::2013-12-12 10:22:24,353::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-51::DEBUG::2013-12-12 10:22:24,518::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-54::DEBUG::2013-12-12 10:22:29,533::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-54::DEBUG::2013-12-12 10:22:29,861::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-55::DEBUG::2013-12-12 10:22:29,870::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-55::DEBUG::2013-12-12 10:22:30,035::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-57::DEBUG::2013-12-12 10:22:33,614::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-57::DEBUG::2013-12-12 10:22:33,786::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-59::DEBUG::2013-12-12 10:22:35,053::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-59::DEBUG::2013-12-12 10:22:35,384::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-60::DEBUG::2013-12-12 10:22:35,392::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-60::DEBUG::2013-12-12 10:22:35,569::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-61::DEBUG::2013-12-12 10:22:36,989::task::579::TaskManager.Task::(_updateState) Task=`5c51760f-0d99-4f6d-96f1-42bd994bbef2`::moving from state init -> state preparing >Thread-61::INFO::2013-12-12 10:22:36,989::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-61::INFO::2013-12-12 10:22:36,989::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-61::DEBUG::2013-12-12 10:22:36,989::task::1168::TaskManager.Task::(prepare) Task=`5c51760f-0d99-4f6d-96f1-42bd994bbef2`::finished: {} >Thread-61::DEBUG::2013-12-12 10:22:36,989::task::579::TaskManager.Task::(_updateState) Task=`5c51760f-0d99-4f6d-96f1-42bd994bbef2`::moving from state preparing -> state finished >Thread-61::DEBUG::2013-12-12 10:22:36,990::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-61::DEBUG::2013-12-12 10:22:36,990::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-61::DEBUG::2013-12-12 10:22:36,990::task::974::TaskManager.Task::(_decref) Task=`5c51760f-0d99-4f6d-96f1-42bd994bbef2`::ref 0 aborting False >Thread-66::DEBUG::2013-12-12 10:22:46,098::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-66::DEBUG::2013-12-12 10:22:46,433::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-67::DEBUG::2013-12-12 10:22:46,442::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-67::DEBUG::2013-12-12 10:22:46,608::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-69::DEBUG::2013-12-12 10:22:51,387::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeSet with ('vol', 'nfs.disable', 'off') {} flowID [45d66790] >Thread-70::DEBUG::2013-12-12 10:22:52,089::task::579::TaskManager.Task::(_updateState) Task=`46185450-f7f9-417b-81b9-e17a8c0cac74`::moving from state init -> state preparing >Thread-70::INFO::2013-12-12 10:22:52,089::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-70::INFO::2013-12-12 10:22:52,089::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-70::DEBUG::2013-12-12 10:22:52,089::task::1168::TaskManager.Task::(prepare) Task=`46185450-f7f9-417b-81b9-e17a8c0cac74`::finished: {} >Thread-70::DEBUG::2013-12-12 10:22:52,089::task::579::TaskManager.Task::(_updateState) Task=`46185450-f7f9-417b-81b9-e17a8c0cac74`::moving from state preparing -> state finished >Thread-70::DEBUG::2013-12-12 10:22:52,090::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2013-12-12 10:22:52,090::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2013-12-12 10:22:52,090::task::974::TaskManager.Task::(_decref) Task=`46185450-f7f9-417b-81b9-e17a8c0cac74`::ref 0 aborting False >Thread-69::DEBUG::2013-12-12 10:22:54,505::BindingXMLRPC::991::vds::(wrapper) return volumeSet with {'status': {'message': 'Done', 'code': 0}} >Thread-74::DEBUG::2013-12-12 10:23:01,206::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-74::DEBUG::2013-12-12 10:23:01,539::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-76::DEBUG::2013-12-12 10:23:01,553::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-76::DEBUG::2013-12-12 10:23:01,720::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'vol': {'transportType': ['TCP'], 'uuid': '5d1d3878-b000-427c-b5ca-42adc33aa124', 'bricks': ['latest-a:/bricks/1', 'latest-b:/bricks/2'], 'volumeName': 'vol', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '2', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-78::DEBUG::2013-12-12 10:23:06,750::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-78::DEBUG::2013-12-12 10:23:07,084::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-79::DEBUG::2013-12-12 10:23:07,098::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-80::DEBUG::2013-12-12 10:23:07,244::task::579::TaskManager.Task::(_updateState) Task=`7e8bdb20-46a2-43ad-a066-5c93258b8db9`::moving from state init -> state preparing >Thread-80::INFO::2013-12-12 10:23:07,244::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-80::INFO::2013-12-12 10:23:07,245::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-80::DEBUG::2013-12-12 10:23:07,245::task::1168::TaskManager.Task::(prepare) Task=`7e8bdb20-46a2-43ad-a066-5c93258b8db9`::finished: {} >Thread-80::DEBUG::2013-12-12 10:23:07,245::task::579::TaskManager.Task::(_updateState) Task=`7e8bdb20-46a2-43ad-a066-5c93258b8db9`::moving from state preparing -> state finished >Thread-80::DEBUG::2013-12-12 10:23:07,245::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-80::DEBUG::2013-12-12 10:23:07,245::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-80::DEBUG::2013-12-12 10:23:07,245::task::974::TaskManager.Task::(_decref) Task=`7e8bdb20-46a2-43ad-a066-5c93258b8db9`::ref 0 aborting False >Thread-79::DEBUG::2013-12-12 10:23:07,276::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'vol': {'transportType': ['TCP'], 'uuid': '5d1d3878-b000-427c-b5ca-42adc33aa124', 'bricks': ['latest-a:/bricks/1', 'latest-b:/bricks/2'], 'volumeName': 'vol', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '2', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-86::DEBUG::2013-12-12 10:23:22,346::task::579::TaskManager.Task::(_updateState) Task=`3a93ebab-ccbf-475e-9ae4-428ffe8be267`::moving from state init -> state preparing >Thread-86::INFO::2013-12-12 10:23:22,346::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-86::INFO::2013-12-12 10:23:22,347::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-86::DEBUG::2013-12-12 10:23:22,347::task::1168::TaskManager.Task::(prepare) Task=`3a93ebab-ccbf-475e-9ae4-428ffe8be267`::finished: {} >Thread-86::DEBUG::2013-12-12 10:23:22,347::task::579::TaskManager.Task::(_updateState) Task=`3a93ebab-ccbf-475e-9ae4-428ffe8be267`::moving from state preparing -> state finished >Thread-86::DEBUG::2013-12-12 10:23:22,347::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-86::DEBUG::2013-12-12 10:23:22,347::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-86::DEBUG::2013-12-12 10:23:22,348::task::974::TaskManager.Task::(_decref) Task=`3a93ebab-ccbf-475e-9ae4-428ffe8be267`::ref 0 aborting False >Thread-88::DEBUG::2013-12-12 10:23:23,390::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-88::DEBUG::2013-12-12 10:23:23,720::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-89::DEBUG::2013-12-12 10:23:23,729::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-89::DEBUG::2013-12-12 10:23:23,899::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'vol': {'transportType': ['TCP'], 'uuid': '5d1d3878-b000-427c-b5ca-42adc33aa124', 'bricks': ['latest-a:/bricks/1', 'latest-b:/bricks/2'], 'volumeName': 'vol', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '2', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-90::DEBUG::2013-12-12 10:23:23,900::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeRebalanceStart with ('vol', False, False) {} flowID [727c482e] >Thread-93::DEBUG::2013-12-12 10:23:28,926::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-93::DEBUG::2013-12-12 10:23:29,548::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-94::DEBUG::2013-12-12 10:23:29,571::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-94::DEBUG::2013-12-12 10:23:29,738::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'vol': {'transportType': ['TCP'], 'uuid': '5d1d3878-b000-427c-b5ca-42adc33aa124', 'bricks': ['latest-a:/bricks/1', 'latest-b:/bricks/2'], 'volumeName': 'vol', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '2', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-90::DEBUG::2013-12-12 10:23:34,629::BindingXMLRPC::991::vds::(wrapper) return volumeRebalanceStart with {'status': {'message': 'Done', 'code': 0}, 'taskId': 'b1d4b5df-dd69-42a6-9be3-9ad494025593'} >Thread-97::DEBUG::2013-12-12 10:23:37,467::task::579::TaskManager.Task::(_updateState) Task=`a396b40d-4ebe-4390-bf51-8a6390d712f6`::moving from state init -> state preparing >Thread-97::INFO::2013-12-12 10:23:37,467::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2013-12-12 10:23:37,468::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-97::DEBUG::2013-12-12 10:23:37,468::task::1168::TaskManager.Task::(prepare) Task=`a396b40d-4ebe-4390-bf51-8a6390d712f6`::finished: {} >Thread-97::DEBUG::2013-12-12 10:23:37,468::task::579::TaskManager.Task::(_updateState) Task=`a396b40d-4ebe-4390-bf51-8a6390d712f6`::moving from state preparing -> state finished >Thread-97::DEBUG::2013-12-12 10:23:37,468::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2013-12-12 10:23:37,468::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2013-12-12 10:23:37,468::task::974::TaskManager.Task::(_decref) Task=`a396b40d-4ebe-4390-bf51-8a6390d712f6`::ref 0 aborting False >Thread-103::DEBUG::2013-12-12 10:23:51,715::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-103::DEBUG::2013-12-12 10:23:52,049::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-104::DEBUG::2013-12-12 10:23:52,062::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-104::DEBUG::2013-12-12 10:23:52,230::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'vol': {'transportType': ['TCP'], 'uuid': '5d1d3878-b000-427c-b5ca-42adc33aa124', 'bricks': ['latest-a:/bricks/1', 'latest-b:/bricks/2'], 'volumeName': 'vol', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '2', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-105::DEBUG::2013-12-12 10:23:52,581::task::579::TaskManager.Task::(_updateState) Task=`ed3ba246-b6b4-46fb-9625-59002d374a22`::moving from state init -> state preparing >Thread-105::INFO::2013-12-12 10:23:52,581::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-105::INFO::2013-12-12 10:23:52,581::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-105::DEBUG::2013-12-12 10:23:52,581::task::1168::TaskManager.Task::(prepare) Task=`ed3ba246-b6b4-46fb-9625-59002d374a22`::finished: {} >Thread-105::DEBUG::2013-12-12 10:23:52,581::task::579::TaskManager.Task::(_updateState) Task=`ed3ba246-b6b4-46fb-9625-59002d374a22`::moving from state preparing -> state finished >Thread-105::DEBUG::2013-12-12 10:23:52,581::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-105::DEBUG::2013-12-12 10:23:52,582::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-105::DEBUG::2013-12-12 10:23:52,582::task::974::TaskManager.Task::(_decref) Task=`ed3ba246-b6b4-46fb-9625-59002d374a22`::ref 0 aborting False >Thread-108::DEBUG::2013-12-12 10:23:57,261::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-108::DEBUG::2013-12-12 10:23:57,597::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-109::DEBUG::2013-12-12 10:23:57,606::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-109::DEBUG::2013-12-12 10:23:57,773::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'vol': {'transportType': ['TCP'], 'uuid': '5d1d3878-b000-427c-b5ca-42adc33aa124', 'bricks': ['latest-a:/bricks/1', 'latest-b:/bricks/2'], 'volumeName': 'vol', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '2', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-113::DEBUG::2013-12-12 10:24:07,701::task::579::TaskManager.Task::(_updateState) Task=`dc3a55a9-110c-44a6-910a-ebc06ca3f0c2`::moving from state init -> state preparing >Thread-113::INFO::2013-12-12 10:24:07,701::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-113::INFO::2013-12-12 10:24:07,701::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-113::DEBUG::2013-12-12 10:24:07,701::task::1168::TaskManager.Task::(prepare) Task=`dc3a55a9-110c-44a6-910a-ebc06ca3f0c2`::finished: {} >Thread-113::DEBUG::2013-12-12 10:24:07,702::task::579::TaskManager.Task::(_updateState) Task=`dc3a55a9-110c-44a6-910a-ebc06ca3f0c2`::moving from state preparing -> state finished >Thread-113::DEBUG::2013-12-12 10:24:07,702::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2013-12-12 10:24:07,702::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2013-12-12 10:24:07,702::task::974::TaskManager.Task::(_decref) Task=`dc3a55a9-110c-44a6-910a-ebc06ca3f0c2`::ref 0 aborting False >Thread-118::DEBUG::2013-12-12 10:24:19,407::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-118::DEBUG::2013-12-12 10:24:19,736::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-119::DEBUG::2013-12-12 10:24:19,749::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-119::DEBUG::2013-12-12 10:24:19,917::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'vol': {'transportType': ['TCP'], 'uuid': '5d1d3878-b000-427c-b5ca-42adc33aa124', 'bricks': ['latest-a:/bricks/1', 'latest-b:/bricks/2'], 'volumeName': 'vol', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '2', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-121::DEBUG::2013-12-12 10:24:22,942::task::579::TaskManager.Task::(_updateState) Task=`abe2bc09-27e4-4b09-aaed-7dca9958e5e2`::moving from state init -> state preparing >Thread-121::INFO::2013-12-12 10:24:22,942::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-121::INFO::2013-12-12 10:24:22,942::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-121::DEBUG::2013-12-12 10:24:22,942::task::1168::TaskManager.Task::(prepare) Task=`abe2bc09-27e4-4b09-aaed-7dca9958e5e2`::finished: {} >Thread-121::DEBUG::2013-12-12 10:24:22,943::task::579::TaskManager.Task::(_updateState) Task=`abe2bc09-27e4-4b09-aaed-7dca9958e5e2`::moving from state preparing -> state finished >Thread-121::DEBUG::2013-12-12 10:24:22,943::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-121::DEBUG::2013-12-12 10:24:22,943::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-121::DEBUG::2013-12-12 10:24:22,943::task::974::TaskManager.Task::(_decref) Task=`abe2bc09-27e4-4b09-aaed-7dca9958e5e2`::ref 0 aborting False >Thread-125::DEBUG::2013-12-12 10:24:30,485::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-125::DEBUG::2013-12-12 10:24:30,816::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-126::DEBUG::2013-12-12 10:24:30,824::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-126::DEBUG::2013-12-12 10:24:30,990::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'vol': {'transportType': ['TCP'], 'uuid': '5d1d3878-b000-427c-b5ca-42adc33aa124', 'bricks': ['latest-a:/bricks/1', 'latest-b:/bricks/2'], 'volumeName': 'vol', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '2', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-128::DEBUG::2013-12-12 10:24:34,643::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-128::DEBUG::2013-12-12 10:24:34,982::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {'b1d4b5df-dd69-42a6-9be3-9ad494025593': {'volume': 'vol', 'status': 'COMPLETED', 'type': 'REBALANCE', 'bricks': [], 'data': {'totalSizeMoved': '0', 'status': 'COMPLETED', 'filesSkipped': '0', 'filesFailed': '0', 'filesMoved': '0', 'runtime': '0.00', 'filesScanned': '0'}}}} >Thread-130::DEBUG::2013-12-12 10:24:36,015::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-130::DEBUG::2013-12-12 10:24:36,346::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-131::DEBUG::2013-12-12 10:24:36,354::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-131::DEBUG::2013-12-12 10:24:36,532::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'vol': {'transportType': ['TCP'], 'uuid': '5d1d3878-b000-427c-b5ca-42adc33aa124', 'bricks': ['latest-a:/bricks/1', 'latest-b:/bricks/2'], 'volumeName': 'vol', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '2', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-132::DEBUG::2013-12-12 10:24:38,048::task::579::TaskManager.Task::(_updateState) Task=`dd87d5c5-dfe0-4b0b-b92d-38fdd0efcbd9`::moving from state init -> state preparing >Thread-132::INFO::2013-12-12 10:24:38,049::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-132::INFO::2013-12-12 10:24:38,049::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-132::DEBUG::2013-12-12 10:24:38,049::task::1168::TaskManager.Task::(prepare) Task=`dd87d5c5-dfe0-4b0b-b92d-38fdd0efcbd9`::finished: {} >Thread-132::DEBUG::2013-12-12 10:24:38,049::task::579::TaskManager.Task::(_updateState) Task=`dd87d5c5-dfe0-4b0b-b92d-38fdd0efcbd9`::moving from state preparing -> state finished >Thread-132::DEBUG::2013-12-12 10:24:38,049::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-132::DEBUG::2013-12-12 10:24:38,049::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-132::DEBUG::2013-12-12 10:24:38,050::task::974::TaskManager.Task::(_decref) Task=`dd87d5c5-dfe0-4b0b-b92d-38fdd0efcbd9`::ref 0 aborting False >Thread-135::DEBUG::2013-12-12 10:24:41,551::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-135::DEBUG::2013-12-12 10:24:41,884::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-136::DEBUG::2013-12-12 10:24:41,892::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-136::DEBUG::2013-12-12 10:24:42,061::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'vol': {'transportType': ['TCP'], 'uuid': '5d1d3878-b000-427c-b5ca-42adc33aa124', 'bricks': ['latest-a:/bricks/1', 'latest-b:/bricks/2'], 'volumeName': 'vol', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '2', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-140::DEBUG::2013-12-12 10:24:52,616::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-140::DEBUG::2013-12-12 10:24:52,946::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-141::DEBUG::2013-12-12 10:24:52,955::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-141::DEBUG::2013-12-12 10:24:53,122::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'vol': {'transportType': ['TCP'], 'uuid': '5d1d3878-b000-427c-b5ca-42adc33aa124', 'bricks': ['latest-a:/bricks/1', 'latest-b:/bricks/2'], 'volumeName': 'vol', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '2', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-142::DEBUG::2013-12-12 10:24:53,156::task::579::TaskManager.Task::(_updateState) Task=`f97c6120-d58e-44ea-8b66-bd36307cf39e`::moving from state init -> state preparing >Thread-142::INFO::2013-12-12 10:24:53,156::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-142::INFO::2013-12-12 10:24:53,156::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-142::DEBUG::2013-12-12 10:24:53,157::task::1168::TaskManager.Task::(prepare) Task=`f97c6120-d58e-44ea-8b66-bd36307cf39e`::finished: {} >Thread-142::DEBUG::2013-12-12 10:24:53,157::task::579::TaskManager.Task::(_updateState) Task=`f97c6120-d58e-44ea-8b66-bd36307cf39e`::moving from state preparing -> state finished >Thread-142::DEBUG::2013-12-12 10:24:53,157::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-142::DEBUG::2013-12-12 10:24:53,157::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-142::DEBUG::2013-12-12 10:24:53,157::task::974::TaskManager.Task::(_decref) Task=`f97c6120-d58e-44ea-8b66-bd36307cf39e`::ref 0 aborting False >Thread-145::DEBUG::2013-12-12 10:24:58,144::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-145::DEBUG::2013-12-12 10:24:58,478::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-146::DEBUG::2013-12-12 10:24:58,489::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-146::DEBUG::2013-12-12 10:24:58,659::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'vol': {'transportType': ['TCP'], 'uuid': '5d1d3878-b000-427c-b5ca-42adc33aa124', 'bricks': ['latest-a:/bricks/1', 'latest-b:/bricks/2'], 'volumeName': 'vol', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '2', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-150::DEBUG::2013-12-12 10:25:08,264::task::579::TaskManager.Task::(_updateState) Task=`bacd6e5b-54e7-4598-8c36-1cb08c27d00c`::moving from state init -> state preparing >Thread-150::INFO::2013-12-12 10:25:08,264::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-150::INFO::2013-12-12 10:25:08,265::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-150::DEBUG::2013-12-12 10:25:08,265::task::1168::TaskManager.Task::(prepare) Task=`bacd6e5b-54e7-4598-8c36-1cb08c27d00c`::finished: {} >Thread-150::DEBUG::2013-12-12 10:25:08,265::task::579::TaskManager.Task::(_updateState) Task=`bacd6e5b-54e7-4598-8c36-1cb08c27d00c`::moving from state preparing -> state finished >Thread-150::DEBUG::2013-12-12 10:25:08,265::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-150::DEBUG::2013-12-12 10:25:08,265::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-150::DEBUG::2013-12-12 10:25:08,265::task::974::TaskManager.Task::(_decref) Task=`bacd6e5b-54e7-4598-8c36-1cb08c27d00c`::ref 0 aborting False >Thread-152::DEBUG::2013-12-12 10:25:09,210::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-152::DEBUG::2013-12-12 10:25:09,541::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-153::DEBUG::2013-12-12 10:25:09,552::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-153::DEBUG::2013-12-12 10:25:09,719::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'vol': {'transportType': ['TCP'], 'uuid': '5d1d3878-b000-427c-b5ca-42adc33aa124', 'bricks': ['latest-a:/bricks/1', 'latest-b:/bricks/2'], 'volumeName': 'vol', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '2', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-156::DEBUG::2013-12-12 10:25:14,738::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-156::DEBUG::2013-12-12 10:25:15,068::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-157::DEBUG::2013-12-12 10:25:15,076::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-157::DEBUG::2013-12-12 10:25:15,246::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'vol': {'transportType': ['TCP'], 'uuid': '5d1d3878-b000-427c-b5ca-42adc33aa124', 'bricks': ['latest-a:/bricks/1', 'latest-b:/bricks/2'], 'volumeName': 'vol', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '2', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-160::DEBUG::2013-12-12 10:25:23,390::task::579::TaskManager.Task::(_updateState) Task=`e2f5d98c-0d1e-4238-a941-a5335681425b`::moving from state init -> state preparing >Thread-160::INFO::2013-12-12 10:25:23,390::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-160::INFO::2013-12-12 10:25:23,391::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-160::DEBUG::2013-12-12 10:25:23,391::task::1168::TaskManager.Task::(prepare) Task=`e2f5d98c-0d1e-4238-a941-a5335681425b`::finished: {} >Thread-160::DEBUG::2013-12-12 10:25:23,391::task::579::TaskManager.Task::(_updateState) Task=`e2f5d98c-0d1e-4238-a941-a5335681425b`::moving from state preparing -> state finished >Thread-160::DEBUG::2013-12-12 10:25:23,391::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-160::DEBUG::2013-12-12 10:25:23,391::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-160::DEBUG::2013-12-12 10:25:23,391::task::974::TaskManager.Task::(_decref) Task=`e2f5d98c-0d1e-4238-a941-a5335681425b`::ref 0 aborting False >Thread-164::DEBUG::2013-12-12 10:25:31,335::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-164::DEBUG::2013-12-12 10:25:31,679::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-165::DEBUG::2013-12-12 10:25:31,688::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-165::DEBUG::2013-12-12 10:25:31,856::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'vol': {'transportType': ['TCP'], 'uuid': '5d1d3878-b000-427c-b5ca-42adc33aa124', 'bricks': ['latest-a:/bricks/1', 'latest-b:/bricks/2'], 'volumeName': 'vol', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '2', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-168::DEBUG::2013-12-12 10:25:36,882::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-168::DEBUG::2013-12-12 10:25:37,218::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-169::DEBUG::2013-12-12 10:25:37,226::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-169::DEBUG::2013-12-12 10:25:37,395::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'vol': {'transportType': ['TCP'], 'uuid': '5d1d3878-b000-427c-b5ca-42adc33aa124', 'bricks': ['latest-a:/bricks/1', 'latest-b:/bricks/2'], 'volumeName': 'vol', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '2', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-170::DEBUG::2013-12-12 10:25:38,503::task::579::TaskManager.Task::(_updateState) Task=`a24174d4-fbb4-479f-99ad-9a8d2a6e37d8`::moving from state init -> state preparing >Thread-170::INFO::2013-12-12 10:25:38,503::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-170::INFO::2013-12-12 10:25:38,503::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-170::DEBUG::2013-12-12 10:25:38,503::task::1168::TaskManager.Task::(prepare) Task=`a24174d4-fbb4-479f-99ad-9a8d2a6e37d8`::finished: {} >Thread-170::DEBUG::2013-12-12 10:25:38,503::task::579::TaskManager.Task::(_updateState) Task=`a24174d4-fbb4-479f-99ad-9a8d2a6e37d8`::moving from state preparing -> state finished >Thread-170::DEBUG::2013-12-12 10:25:38,504::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-170::DEBUG::2013-12-12 10:25:38,504::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-170::DEBUG::2013-12-12 10:25:38,504::task::974::TaskManager.Task::(_decref) Task=`a24174d4-fbb4-479f-99ad-9a8d2a6e37d8`::ref 0 aborting False >Thread-173::DEBUG::2013-12-12 10:25:42,414::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-173::DEBUG::2013-12-12 10:25:42,748::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-174::DEBUG::2013-12-12 10:25:42,759::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-174::DEBUG::2013-12-12 10:25:42,924::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'vol': {'transportType': ['TCP'], 'uuid': '5d1d3878-b000-427c-b5ca-42adc33aa124', 'bricks': ['latest-a:/bricks/1', 'latest-b:/bricks/2'], 'volumeName': 'vol', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '2', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-178::DEBUG::2013-12-12 10:25:53,667::task::579::TaskManager.Task::(_updateState) Task=`b74b1633-27b1-4f87-a51d-b7ddfe0b9e2a`::moving from state init -> state preparing >Thread-178::INFO::2013-12-12 10:25:53,667::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-178::INFO::2013-12-12 10:25:53,667::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-178::DEBUG::2013-12-12 10:25:53,667::task::1168::TaskManager.Task::(prepare) Task=`b74b1633-27b1-4f87-a51d-b7ddfe0b9e2a`::finished: {} >Thread-178::DEBUG::2013-12-12 10:25:53,667::task::579::TaskManager.Task::(_updateState) Task=`b74b1633-27b1-4f87-a51d-b7ddfe0b9e2a`::moving from state preparing -> state finished >Thread-178::DEBUG::2013-12-12 10:25:53,668::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-178::DEBUG::2013-12-12 10:25:53,668::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-178::DEBUG::2013-12-12 10:25:53,668::task::974::TaskManager.Task::(_decref) Task=`b74b1633-27b1-4f87-a51d-b7ddfe0b9e2a`::ref 0 aborting False >Thread-182::DEBUG::2013-12-12 10:26:01,717::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeStop with ('vol', False) {} flowID [4f05f42] >Thread-182::DEBUG::2013-12-12 10:26:06,738::BindingXMLRPC::991::vds::(wrapper) return volumeStop with {'status': {'message': 'Done', 'code': 0}} >Thread-185::DEBUG::2013-12-12 10:26:07,884::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeDelete with ('vol',) {} flowID [c4f02fb] >Thread-185::DEBUG::2013-12-12 10:26:08,056::BindingXMLRPC::991::vds::(wrapper) return volumeDelete with {'status': {'message': 'Done', 'code': 0}} >Thread-186::DEBUG::2013-12-12 10:26:09,045::task::579::TaskManager.Task::(_updateState) Task=`134cbfb4-d052-4b35-9195-076a005d3d0a`::moving from state init -> state preparing >Thread-186::INFO::2013-12-12 10:26:09,045::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-186::INFO::2013-12-12 10:26:09,045::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-186::DEBUG::2013-12-12 10:26:09,045::task::1168::TaskManager.Task::(prepare) Task=`134cbfb4-d052-4b35-9195-076a005d3d0a`::finished: {} >Thread-186::DEBUG::2013-12-12 10:26:09,045::task::579::TaskManager.Task::(_updateState) Task=`134cbfb4-d052-4b35-9195-076a005d3d0a`::moving from state preparing -> state finished >Thread-186::DEBUG::2013-12-12 10:26:09,045::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-186::DEBUG::2013-12-12 10:26:09,046::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-186::DEBUG::2013-12-12 10:26:09,046::task::974::TaskManager.Task::(_decref) Task=`134cbfb4-d052-4b35-9195-076a005d3d0a`::ref 0 aborting False >Thread-189::DEBUG::2013-12-12 10:26:12,349::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-189::DEBUG::2013-12-12 10:26:12,681::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-190::DEBUG::2013-12-12 10:26:12,696::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-190::DEBUG::2013-12-12 10:26:12,865::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-191::DEBUG::2013-12-12 10:26:13,899::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostRemove with ('latest-a', False) {} flowID [305e98ae] >Thread-191::DEBUG::2013-12-12 10:26:14,067::BindingXMLRPC::991::vds::(wrapper) return hostRemove with {'status': {'message': 'Done', 'code': 0}} >Thread-192::DEBUG::2013-12-12 10:26:15,136::task::579::TaskManager.Task::(_updateState) Task=`a2e27d9f-0b62-4f86-af2f-04aa52435f8e`::moving from state init -> state preparing >Thread-192::INFO::2013-12-12 10:26:15,136::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-192::INFO::2013-12-12 10:26:15,137::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-192::DEBUG::2013-12-12 10:26:15,137::task::1168::TaskManager.Task::(prepare) Task=`a2e27d9f-0b62-4f86-af2f-04aa52435f8e`::finished: {} >Thread-192::DEBUG::2013-12-12 10:26:15,137::task::579::TaskManager.Task::(_updateState) Task=`a2e27d9f-0b62-4f86-af2f-04aa52435f8e`::moving from state preparing -> state finished >Thread-192::DEBUG::2013-12-12 10:26:15,137::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-192::DEBUG::2013-12-12 10:26:15,137::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-192::DEBUG::2013-12-12 10:26:15,137::task::974::TaskManager.Task::(_decref) Task=`a2e27d9f-0b62-4f86-af2f-04aa52435f8e`::ref 0 aborting False >MainThread::DEBUG::2013-12-12 10:29:46,130::vdsm::45::vds::(sigtermHandler) Received signal 15 >MainThread::INFO::2013-12-12 10:29:46,400::vmChannels::183::vds::(stop) VM channels listener was stopped. >MainThread::DEBUG::2013-12-12 10:29:46,400::task::579::TaskManager.Task::(_updateState) Task=`bc270f7f-b020-48eb-a49b-b2012e72844a`::moving from state init -> state preparing >MainThread::INFO::2013-12-12 10:29:46,401::logUtils::44::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2013-12-12 10:29:46,424::storageServer::698::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::INFO::2013-12-12 10:29:46,706::domainMonitor::126::Storage.DomainMonitor::(close) Stopping domain monitors >MainThread::DEBUG::2013-12-12 10:29:46,706::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2013-12-12 10:29:46,707::logUtils::47::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2013-12-12 10:29:46,707::task::1168::TaskManager.Task::(prepare) Task=`bc270f7f-b020-48eb-a49b-b2012e72844a`::finished: None >MainThread::DEBUG::2013-12-12 10:29:46,707::task::579::TaskManager.Task::(_updateState) Task=`bc270f7f-b020-48eb-a49b-b2012e72844a`::moving from state preparing -> state finished >MainThread::DEBUG::2013-12-12 10:29:46,707::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-12-12 10:29:46,707::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-12-12 10:29:46,708::task::974::TaskManager.Task::(_decref) Task=`bc270f7f-b020-48eb-a49b-b2012e72844a`::ref 0 aborting False >MainThread::INFO::2013-12-12 10:29:46,708::vdsm::107::vds::(run) VDSM main thread ended. Waiting for 13 other threads... >MainThread::INFO::2013-12-12 10:29:46,708::vdsm::111::vds::(run) <_MainThread(MainThread, started 139854583518976)> >MainThread::INFO::2013-12-12 10:29:46,708::vdsm::111::vds::(run) <Thread(libvirtEventLoop, started daemon 139854363440896)> >MainThread::INFO::2013-12-12 10:29:46,708::vdsm::111::vds::(run) <WorkerThread(Thread-10, started daemon 139853731723008)> >MainThread::INFO::2013-12-12 10:29:46,708::vdsm::111::vds::(run) <WorkerThread(Thread-1, started daemon 139854234302208)> >MainThread::INFO::2013-12-12 10:29:46,708::vdsm::111::vds::(run) <WorkerThread(Thread-7, started daemon 139853968688896)> >MainThread::INFO::2013-12-12 10:29:46,709::vdsm::111::vds::(run) <KsmMonitorThread(KsmMonitor, started daemon 139853689763584)> >MainThread::INFO::2013-12-12 10:29:46,709::vdsm::111::vds::(run) <WorkerThread(Thread-6, started daemon 139853979178752)> >MainThread::INFO::2013-12-12 10:29:46,709::vdsm::111::vds::(run) <WorkerThread(Thread-9, started daemon 139853947709184)> >MainThread::INFO::2013-12-12 10:29:46,709::vdsm::111::vds::(run) <WorkerThread(Thread-5, started daemon 139853989668608)> >MainThread::INFO::2013-12-12 10:29:46,709::vdsm::111::vds::(run) <WorkerThread(Thread-8, started daemon 139853958199040)> >MainThread::INFO::2013-12-12 10:29:46,709::vdsm::111::vds::(run) <WorkerThread(Thread-4, started daemon 139854000158464)> >MainThread::INFO::2013-12-12 10:29:46,710::vdsm::111::vds::(run) <WorkerThread(Thread-3, started daemon 139854213322496)> >MainThread::INFO::2013-12-12 10:29:46,710::vdsm::111::vds::(run) <WorkerThread(Thread-2, started daemon 139854223812352)> >MainThread::INFO::2013-12-12 10:29:46,710::vmChannels::183::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2013-12-12 10:29:46,710::vdsm::111::vds::(run) <Listener(VM Channels Listener, started daemon 139853597505280)> >MainThread::INFO::2013-12-12 10:30:02,932::vdsm::101::vds::(run) (PID: 13310) I am the actual vdsm 4.13.0-23.1.el6rhs rhs-21u2-20131208-b (2.6.32-358.28.1.el6.x86_64) >MainThread::DEBUG::2013-12-12 10:30:03,185::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2013-12-12 10:30:03,186::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2013-12-12 10:30:03,190::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2013-12-12 10:30:03,731::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::INFO::2013-12-12 10:30:03,751::multipath::134::Storage.Multipath::(isEnabled) Manual override for multipath.conf detected - preserving current configuration >MainThread::WARNING::2013-12-12 10:30:03,751::multipath::137::Storage.Multipath::(isEnabled) This manual override for multipath.conf was based on downrevved template. You are strongly advised to contact your support representatives >MainThread::DEBUG::2013-12-12 10:30:03,751::hsm::426::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2013-12-12 10:30:03,790::hsm::426::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-12-12 10:30:03,791::hsm::450::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2013-12-12 10:30:03,793::hsm::482::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2013-12-12 10:30:03,793::hsm::483::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2013-12-12 10:30:03,793::hsm::485::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2013-12-12 10:30:03,794::hsm::528::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2013-12-12 10:30:03,798::dispatcher::98::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >MainThread::DEBUG::2013-12-12 10:30:03,798::task::579::TaskManager.Task::(_updateState) Task=`febc8a91-dd74-45c6-8d8f-cd843518d632`::moving from state init -> state preparing >MainThread::INFO::2013-12-12 10:30:03,799::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0x7fd0d0184200>>) >MainThread::INFO::2013-12-12 10:30:03,799::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None >MainThread::DEBUG::2013-12-12 10:30:03,799::task::1168::TaskManager.Task::(prepare) Task=`febc8a91-dd74-45c6-8d8f-cd843518d632`::finished: None >MainThread::DEBUG::2013-12-12 10:30:03,799::task::579::TaskManager.Task::(_updateState) Task=`febc8a91-dd74-45c6-8d8f-cd843518d632`::moving from state preparing -> state finished >MainThread::DEBUG::2013-12-12 10:30:03,799::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-12-12 10:30:03,799::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-12-12 10:30:03,800::task::974::TaskManager.Task::(_decref) Task=`febc8a91-dd74-45c6-8d8f-cd843518d632`::ref 0 aborting False >storageRefresh::DEBUG::2013-12-12 10:30:03,804::lvm::338::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 10:30:03,805::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::WARNING::2013-12-12 10:30:03,814::clientIF::196::vds::(_prepareMOM) MOM is not available, fallback to KsmMonitor >MainThread::DEBUG::2013-12-12 10:30:03,814::utils::489::root::(execCmd) '/usr/bin/pgrep -xf ksmd' (cwd None) >MainThread::DEBUG::2013-12-12 10:30:03,839::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2013-12-12 10:30:03,839::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 29 >storageRefresh::DEBUG::2013-12-12 10:30:03,867::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 10:30:03,868::lvm::363::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 10:30:03,868::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 10:30:03,869::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >KsmMonitor::DEBUG::2013-12-12 10:30:03,877::utils::489::root::(execCmd) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2013-12-12 10:30:03,886::vmChannels::187::vds::(settimeout) Setting channels' timeout to 30 seconds. >clientIFinit::DEBUG::2013-12-12 10:30:03,887::libvirtconnection::131::libvirtconnection::(get) trying to connect libvirt >storageRefresh::DEBUG::2013-12-12 10:30:03,929::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 10:30:03,930::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 10:30:03,931::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >VM Channels Listener::INFO::2013-12-12 10:30:03,945::vmChannels::170::vds::(run) Starting VM channels listener thread. >storageRefresh::DEBUG::2013-12-12 10:30:03,966::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 10:30:03,966::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 10:30:03,967::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >storageRefresh::DEBUG::2013-12-12 10:30:04,010::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 10:30:04,011::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 10:30:04,011::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >storageRefresh::DEBUG::2013-12-12 10:30:04,011::misc::811::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-12-12 10:30:04,011::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2013-12-12 10:30:04,012::misc::811::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-12-12 10:30:04,012::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2013-12-12 10:30:04,052::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >storageRefresh::DEBUG::2013-12-12 10:30:04,053::misc::819::SamplingMethod::(__call__) Returning last result >Thread-13::DEBUG::2013-12-12 10:30:04,574::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call ping with () {} flowID [9ae73a1] >Thread-13::DEBUG::2013-12-12 10:30:04,575::BindingXMLRPC::991::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-14::DEBUG::2013-12-12 10:30:04,581::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getCapabilities with () {} flowID [9ae73a1] >Thread-14::DEBUG::2013-12-12 10:30:04,655::utils::489::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-14::DEBUG::2013-12-12 10:30:04,686::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2013-12-12 10:30:04,715::caps::363::root::(_getKeyPackages) rpm package glusterfs-rdma not found >Thread-14::DEBUG::2013-12-12 10:30:04,715::caps::363::root::(_getKeyPackages) rpm package glusterfs-fuse not found >Thread-14::DEBUG::2013-12-12 10:30:04,715::caps::363::root::(_getKeyPackages) rpm package gluster-swift not found >Thread-14::DEBUG::2013-12-12 10:30:04,716::caps::363::root::(_getKeyPackages) rpm package qemu-kvm-rhev not found >Thread-14::DEBUG::2013-12-12 10:30:04,716::caps::363::root::(_getKeyPackages) rpm package gluster-swift-object not found >Thread-14::DEBUG::2013-12-12 10:30:04,717::caps::363::root::(_getKeyPackages) rpm package glusterfs not found >Thread-14::DEBUG::2013-12-12 10:30:04,717::caps::363::root::(_getKeyPackages) rpm package gluster-swift-plugin not found >Thread-14::DEBUG::2013-12-12 10:30:04,718::caps::363::root::(_getKeyPackages) rpm package qemu-img-rhev not found >Thread-14::DEBUG::2013-12-12 10:30:04,718::caps::363::root::(_getKeyPackages) rpm package ('mom',) not found >Thread-14::DEBUG::2013-12-12 10:30:04,719::caps::363::root::(_getKeyPackages) rpm package gluster-swift-account not found >Thread-14::DEBUG::2013-12-12 10:30:04,719::caps::363::root::(_getKeyPackages) rpm package gluster-swift-proxy not found >Thread-14::DEBUG::2013-12-12 10:30:04,719::caps::363::root::(_getKeyPackages) rpm package gluster-swift-doc not found >Thread-14::DEBUG::2013-12-12 10:30:04,720::caps::363::root::(_getKeyPackages) rpm package glusterfs-server not found >Thread-14::DEBUG::2013-12-12 10:30:04,720::caps::363::root::(_getKeyPackages) rpm package gluster-swift-container not found >Thread-14::DEBUG::2013-12-12 10:30:04,720::caps::363::root::(_getKeyPackages) rpm package glusterfs-geo-replication not found >Thread-14::DEBUG::2013-12-12 10:30:04,724::BindingXMLRPC::991::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.28.1.el6.x86_64', 'buildtime': 1384533955.0, 'version': '2.6.32'}, 'vdsm': {'release': '23.1.el6rhs', 'buildtime': 1386773756L, 'version': '4.13.0'}, 'spice-server': {'release': '12.el6_4.5', 'buildtime': 1381834662L, 'version': '0.12.0'}, 'libvirt': {'release': '18.el6_4.13', 'buildtime': 1379320058L, 'version': '0.10.2'}}, 'cpuModel': 'QEMU Virtual CPU version 1.4.2', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.14.16.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.14.16.254', 'ports': ['eth0']}}, 'uuid': '7B904C94-94EE-7B49-40B3-BD3C28FBB749', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'netmask': '', 'addr': '', 'hwaddr': '52:54:00:b7:60:bc', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': '52:54:00:b7:60:bc', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 100, 'mtu': '1500'}}, 'software_revision': '23.1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': 'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,lm,up,rep_good,unfair_spinlock,pni,cx16,popcnt,hypervisor,lahf_lm', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '4062', 'cpuSpeed': '2393.998', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '1', 'kvmEnabled': 'false', 'rhsVersion': {'release': '1.el6rhs', 'version': '2.1.2.0', 'name': 'RHS'}, 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '1', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.14.16.112'}} >Thread-15::DEBUG::2013-12-12 10:30:05,604::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getCapabilities with () {} >Thread-15::DEBUG::2013-12-12 10:30:05,605::utils::489::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-15::DEBUG::2013-12-12 10:30:05,610::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2013-12-12 10:30:05,622::caps::363::root::(_getKeyPackages) rpm package glusterfs-rdma not found >Thread-15::DEBUG::2013-12-12 10:30:05,623::caps::363::root::(_getKeyPackages) rpm package glusterfs-fuse not found >Thread-15::DEBUG::2013-12-12 10:30:05,623::caps::363::root::(_getKeyPackages) rpm package gluster-swift not found >Thread-15::DEBUG::2013-12-12 10:30:05,624::caps::363::root::(_getKeyPackages) rpm package qemu-kvm-rhev not found >Thread-15::DEBUG::2013-12-12 10:30:05,624::caps::363::root::(_getKeyPackages) rpm package gluster-swift-object not found >Thread-15::DEBUG::2013-12-12 10:30:05,624::caps::363::root::(_getKeyPackages) rpm package glusterfs not found >Thread-15::DEBUG::2013-12-12 10:30:05,625::caps::363::root::(_getKeyPackages) rpm package gluster-swift-plugin not found >Thread-15::DEBUG::2013-12-12 10:30:05,626::caps::363::root::(_getKeyPackages) rpm package qemu-img-rhev not found >Thread-15::DEBUG::2013-12-12 10:30:05,626::caps::363::root::(_getKeyPackages) rpm package ('mom',) not found >Thread-15::DEBUG::2013-12-12 10:30:05,627::caps::363::root::(_getKeyPackages) rpm package gluster-swift-account not found >Thread-15::DEBUG::2013-12-12 10:30:05,627::caps::363::root::(_getKeyPackages) rpm package gluster-swift-proxy not found >Thread-15::DEBUG::2013-12-12 10:30:05,627::caps::363::root::(_getKeyPackages) rpm package gluster-swift-doc not found >Thread-15::DEBUG::2013-12-12 10:30:05,627::caps::363::root::(_getKeyPackages) rpm package glusterfs-server not found >Thread-15::DEBUG::2013-12-12 10:30:05,628::caps::363::root::(_getKeyPackages) rpm package gluster-swift-container not found >Thread-15::DEBUG::2013-12-12 10:30:05,628::caps::363::root::(_getKeyPackages) rpm package glusterfs-geo-replication not found >Thread-15::DEBUG::2013-12-12 10:30:05,629::BindingXMLRPC::991::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.28.1.el6.x86_64', 'buildtime': 1384533955.0, 'version': '2.6.32'}, 'vdsm': {'release': '23.1.el6rhs', 'buildtime': 1386773756L, 'version': '4.13.0'}, 'spice-server': {'release': '12.el6_4.5', 'buildtime': 1381834662L, 'version': '0.12.0'}, 'libvirt': {'release': '18.el6_4.13', 'buildtime': 1379320058L, 'version': '0.10.2'}}, 'cpuModel': 'QEMU Virtual CPU version 1.4.2', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.14.16.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.14.16.254', 'ports': ['eth0']}}, 'uuid': '7B904C94-94EE-7B49-40B3-BD3C28FBB749', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'netmask': '', 'addr': '', 'hwaddr': '52:54:00:b7:60:bc', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': '52:54:00:b7:60:bc', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 100, 'mtu': '1500'}}, 'software_revision': '23.1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': 'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,lm,up,rep_good,unfair_spinlock,pni,cx16,popcnt,hypervisor,lahf_lm', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '4062', 'cpuSpeed': '2393.998', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '1', 'kvmEnabled': 'false', 'rhsVersion': {'release': '1.el6rhs', 'version': '2.1.2.0', 'name': 'RHS'}, 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '1', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.14.16.112'}} >Thread-16::DEBUG::2013-12-12 10:30:05,657::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getHardwareInfo with () {} >Thread-16::DEBUG::2013-12-12 10:30:05,682::BindingXMLRPC::991::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'Bochs', 'systemSerialNumber': 'Not Specified', 'systemFamily': 'Not Specified', 'systemVersion': 'Not Specified', 'systemUUID': '7b904c94-94ee-7b49-40b3-bd3c28fbb749', 'systemManufacturer': 'Bochs'}} >Thread-17::DEBUG::2013-12-12 10:30:05,746::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-17::DEBUG::2013-12-12 10:30:06,080::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}]} >Thread-18::DEBUG::2013-12-12 10:30:06,086::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getCapabilities with () {} >Thread-18::DEBUG::2013-12-12 10:30:06,087::utils::489::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-18::DEBUG::2013-12-12 10:30:06,092::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2013-12-12 10:30:06,104::caps::363::root::(_getKeyPackages) rpm package glusterfs-rdma not found >Thread-18::DEBUG::2013-12-12 10:30:06,105::caps::363::root::(_getKeyPackages) rpm package glusterfs-fuse not found >Thread-18::DEBUG::2013-12-12 10:30:06,105::caps::363::root::(_getKeyPackages) rpm package gluster-swift not found >Thread-18::DEBUG::2013-12-12 10:30:06,106::caps::363::root::(_getKeyPackages) rpm package qemu-kvm-rhev not found >Thread-18::DEBUG::2013-12-12 10:30:06,106::caps::363::root::(_getKeyPackages) rpm package gluster-swift-object not found >Thread-18::DEBUG::2013-12-12 10:30:06,107::caps::363::root::(_getKeyPackages) rpm package glusterfs not found >Thread-18::DEBUG::2013-12-12 10:30:06,107::caps::363::root::(_getKeyPackages) rpm package gluster-swift-plugin not found >Thread-18::DEBUG::2013-12-12 10:30:06,108::caps::363::root::(_getKeyPackages) rpm package qemu-img-rhev not found >Thread-18::DEBUG::2013-12-12 10:30:06,108::caps::363::root::(_getKeyPackages) rpm package ('mom',) not found >Thread-18::DEBUG::2013-12-12 10:30:06,109::caps::363::root::(_getKeyPackages) rpm package gluster-swift-account not found >Thread-18::DEBUG::2013-12-12 10:30:06,109::caps::363::root::(_getKeyPackages) rpm package gluster-swift-proxy not found >Thread-18::DEBUG::2013-12-12 10:30:06,109::caps::363::root::(_getKeyPackages) rpm package gluster-swift-doc not found >Thread-18::DEBUG::2013-12-12 10:30:06,110::caps::363::root::(_getKeyPackages) rpm package glusterfs-server not found >Thread-18::DEBUG::2013-12-12 10:30:06,110::caps::363::root::(_getKeyPackages) rpm package gluster-swift-container not found >Thread-18::DEBUG::2013-12-12 10:30:06,110::caps::363::root::(_getKeyPackages) rpm package glusterfs-geo-replication not found >Thread-18::DEBUG::2013-12-12 10:30:06,111::BindingXMLRPC::991::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.28.1.el6.x86_64', 'buildtime': 1384533955.0, 'version': '2.6.32'}, 'vdsm': {'release': '23.1.el6rhs', 'buildtime': 1386773756L, 'version': '4.13.0'}, 'spice-server': {'release': '12.el6_4.5', 'buildtime': 1381834662L, 'version': '0.12.0'}, 'libvirt': {'release': '18.el6_4.13', 'buildtime': 1379320058L, 'version': '0.10.2'}}, 'cpuModel': 'QEMU Virtual CPU version 1.4.2', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.14.16.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.14.16.254', 'ports': ['eth0']}}, 'uuid': '7B904C94-94EE-7B49-40B3-BD3C28FBB749', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'netmask': '', 'addr': '', 'hwaddr': '52:54:00:b7:60:bc', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': '52:54:00:b7:60:bc', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 100, 'mtu': '1500'}}, 'software_revision': '23.1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': 'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,lm,up,rep_good,unfair_spinlock,pni,cx16,popcnt,hypervisor,lahf_lm', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '4062', 'cpuSpeed': '2393.998', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '1', 'kvmEnabled': 'false', 'rhsVersion': {'release': '1.el6rhs', 'version': '2.1.2.0', 'name': 'RHS'}, 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '1', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.14.16.112'}} >Thread-19::DEBUG::2013-12-12 10:30:06,125::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getHardwareInfo with () {} >Thread-19::DEBUG::2013-12-12 10:30:06,126::BindingXMLRPC::991::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'Bochs', 'systemSerialNumber': 'Not Specified', 'systemFamily': 'Not Specified', 'systemVersion': 'Not Specified', 'systemUUID': '7b904c94-94ee-7b49-40b3-bd3c28fbb749', 'systemManufacturer': 'Bochs'}} >Thread-20::DEBUG::2013-12-12 10:30:06,282::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-20::DEBUG::2013-12-12 10:30:06,616::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}]} >Thread-22::DEBUG::2013-12-12 10:30:06,663::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostUUIDGet with () {} flowID [4104a344] >Thread-22::DEBUG::2013-12-12 10:30:06,832::BindingXMLRPC::991::vds::(wrapper) return hostUUIDGet with {'status': {'message': 'Done', 'code': 0}, 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'} >storageRefresh::DEBUG::2013-12-12 10:30:08,081::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >storageRefresh::DEBUG::2013-12-12 10:30:08,117::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 10:30:08,118::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 10:30:08,118::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 10:30:08,118::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 10:30:08,119::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 10:30:08,119::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 10:30:08,119::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 10:30:08,119::misc::819::SamplingMethod::(__call__) Returning last result >storageRefresh::WARNING::2013-12-12 10:30:08,120::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >KsmMonitor::DEBUG::2013-12-12 10:30:10,079::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2013-12-12 10:30:10,079::utils::489::root::(execCmd) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2013-12-12 10:30:10,135::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-23::DEBUG::2013-12-12 10:30:11,083::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-23::DEBUG::2013-12-12 10:30:12,334::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-24::DEBUG::2013-12-12 10:30:12,349::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-24::DEBUG::2013-12-12 10:30:12,520::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-25::DEBUG::2013-12-12 10:30:12,756::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeCreate with ('StartMigrationDuringRebalanceTest', ['latest-a:/bricks/201312121030108991942637805', 'latest-a:/bricks/20131212103011341850249563', 'latest-a:/bricks/201312121030113411245056192', 'latest-b:/bricks/20131212103011341550199115', 'latest-b:/bricks/20131212103011341516730110', 'latest-b:/bricks/201312121030113411287551485'], 0, 0, ['TCP'], False) {} flowID [788144bc] >Thread-29::DEBUG::2013-12-12 10:30:21,912::task::579::TaskManager.Task::(_updateState) Task=`b356df27-7c3e-4e20-bdfe-b0fe40779749`::moving from state init -> state preparing >Thread-29::INFO::2013-12-12 10:30:21,913::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-29::INFO::2013-12-12 10:30:21,913::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-29::DEBUG::2013-12-12 10:30:21,913::task::1168::TaskManager.Task::(prepare) Task=`b356df27-7c3e-4e20-bdfe-b0fe40779749`::finished: {} >Thread-29::DEBUG::2013-12-12 10:30:21,913::task::579::TaskManager.Task::(_updateState) Task=`b356df27-7c3e-4e20-bdfe-b0fe40779749`::moving from state preparing -> state finished >Thread-29::DEBUG::2013-12-12 10:30:21,913::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-29::DEBUG::2013-12-12 10:30:21,913::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-29::DEBUG::2013-12-12 10:30:21,914::task::974::TaskManager.Task::(_decref) Task=`b356df27-7c3e-4e20-bdfe-b0fe40779749`::ref 0 aborting False >Thread-25::DEBUG::2013-12-12 10:30:27,400::BindingXMLRPC::991::vds::(wrapper) return volumeCreate with {'status': {'message': 'Done', 'code': 0}, 'uuid': '9a0e12c8-84e9-4960-968b-56fab71e014c'} >Thread-33::DEBUG::2013-12-12 10:30:28,541::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-33::DEBUG::2013-12-12 10:30:28,921::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-34::DEBUG::2013-12-12 10:30:28,933::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-34::DEBUG::2013-12-12 10:30:29,098::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '9a0e12c8-84e9-4960-968b-56fab71e014c', 'bricks': ['latest-a:/bricks/201312121030108991942637805', 'latest-a:/bricks/20131212103011341850249563', 'latest-a:/bricks/201312121030113411245056192', 'latest-b:/bricks/20131212103011341550199115', 'latest-b:/bricks/20131212103011341516730110', 'latest-b:/bricks/201312121030113411287551485'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {}}}} >Thread-37::DEBUG::2013-12-12 10:30:37,107::task::579::TaskManager.Task::(_updateState) Task=`d6d544fb-f45e-4629-bed9-81284e0f9b56`::moving from state init -> state preparing >Thread-37::INFO::2013-12-12 10:30:37,107::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-37::INFO::2013-12-12 10:30:37,107::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-37::DEBUG::2013-12-12 10:30:37,107::task::1168::TaskManager.Task::(prepare) Task=`d6d544fb-f45e-4629-bed9-81284e0f9b56`::finished: {} >Thread-37::DEBUG::2013-12-12 10:30:37,107::task::579::TaskManager.Task::(_updateState) Task=`d6d544fb-f45e-4629-bed9-81284e0f9b56`::moving from state preparing -> state finished >Thread-37::DEBUG::2013-12-12 10:30:37,107::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2013-12-12 10:30:37,108::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2013-12-12 10:30:37,108::task::974::TaskManager.Task::(_decref) Task=`d6d544fb-f45e-4629-bed9-81284e0f9b56`::ref 0 aborting False >Thread-41::DEBUG::2013-12-12 10:30:45,434::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeBrickAdd with ('StartMigrationDuringRebalanceTest', ['latest-b:/bricks/20131212103044648927299489'], 0, 0, False) {} flowID [49f6a095] >Thread-44::DEBUG::2013-12-12 10:30:52,297::task::579::TaskManager.Task::(_updateState) Task=`1b908b01-0467-49ed-aeff-d8cef1896242`::moving from state init -> state preparing >Thread-44::INFO::2013-12-12 10:30:52,297::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-44::INFO::2013-12-12 10:30:52,297::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-44::DEBUG::2013-12-12 10:30:52,297::task::1168::TaskManager.Task::(prepare) Task=`1b908b01-0467-49ed-aeff-d8cef1896242`::finished: {} >Thread-44::DEBUG::2013-12-12 10:30:52,298::task::579::TaskManager.Task::(_updateState) Task=`1b908b01-0467-49ed-aeff-d8cef1896242`::moving from state preparing -> state finished >Thread-44::DEBUG::2013-12-12 10:30:52,298::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2013-12-12 10:30:52,298::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2013-12-12 10:30:52,298::task::974::TaskManager.Task::(_decref) Task=`1b908b01-0467-49ed-aeff-d8cef1896242`::ref 0 aborting False >Thread-41::DEBUG::2013-12-12 10:30:54,021::BindingXMLRPC::991::vds::(wrapper) return volumeBrickAdd with {'status': {'message': 'Done', 'code': 0}} >Thread-46::DEBUG::2013-12-12 10:30:54,239::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-46::DEBUG::2013-12-12 10:30:54,646::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-47::DEBUG::2013-12-12 10:30:54,658::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-47::DEBUG::2013-12-12 10:30:54,825::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '9a0e12c8-84e9-4960-968b-56fab71e014c', 'bricks': ['latest-a:/bricks/201312121030108991942637805', 'latest-a:/bricks/20131212103011341850249563', 'latest-a:/bricks/201312121030113411245056192', 'latest-b:/bricks/20131212103011341550199115', 'latest-b:/bricks/20131212103011341516730110', 'latest-b:/bricks/201312121030113411287551485', 'latest-b:/bricks/20131212103044648927299489'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '7', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-48::DEBUG::2013-12-12 10:30:55,374::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeBrickAdd with ('StartMigrationDuringRebalanceTest', ['latest-a:/bricks/20131212103055374341374234'], 0, 0, False) {} flowID [3b3bd4bc] >Thread-48::DEBUG::2013-12-12 10:31:04,902::BindingXMLRPC::991::vds::(wrapper) return volumeBrickAdd with {'status': {'message': 'Done', 'code': 0}} >Thread-53::DEBUG::2013-12-12 10:31:07,459::task::579::TaskManager.Task::(_updateState) Task=`52bdd1c1-2794-4bf4-be74-e8ddb7c59656`::moving from state init -> state preparing >Thread-53::INFO::2013-12-12 10:31:07,459::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53::INFO::2013-12-12 10:31:07,459::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-53::DEBUG::2013-12-12 10:31:07,459::task::1168::TaskManager.Task::(prepare) Task=`52bdd1c1-2794-4bf4-be74-e8ddb7c59656`::finished: {} >Thread-53::DEBUG::2013-12-12 10:31:07,460::task::579::TaskManager.Task::(_updateState) Task=`52bdd1c1-2794-4bf4-be74-e8ddb7c59656`::moving from state preparing -> state finished >Thread-53::DEBUG::2013-12-12 10:31:07,460::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53::DEBUG::2013-12-12 10:31:07,460::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53::DEBUG::2013-12-12 10:31:07,460::task::974::TaskManager.Task::(_decref) Task=`52bdd1c1-2794-4bf4-be74-e8ddb7c59656`::ref 0 aborting False >Thread-57::DEBUG::2013-12-12 10:31:15,355::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-57::DEBUG::2013-12-12 10:31:15,750::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-58::DEBUG::2013-12-12 10:31:15,758::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-58::DEBUG::2013-12-12 10:31:15,927::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '9a0e12c8-84e9-4960-968b-56fab71e014c', 'bricks': ['latest-a:/bricks/201312121030108991942637805', 'latest-a:/bricks/20131212103011341850249563', 'latest-a:/bricks/201312121030113411245056192', 'latest-b:/bricks/20131212103011341550199115', 'latest-b:/bricks/20131212103011341516730110', 'latest-b:/bricks/201312121030113411287551485', 'latest-b:/bricks/20131212103044648927299489', 'latest-a:/bricks/20131212103055374341374234', 'latest-b:/bricks/20131212103105683219930446'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '9', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-61::DEBUG::2013-12-12 10:31:22,657::task::579::TaskManager.Task::(_updateState) Task=`005a10d9-e515-4681-ba00-abc8235b5211`::moving from state init -> state preparing >Thread-61::INFO::2013-12-12 10:31:22,658::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-61::INFO::2013-12-12 10:31:22,658::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-61::DEBUG::2013-12-12 10:31:22,658::task::1168::TaskManager.Task::(prepare) Task=`005a10d9-e515-4681-ba00-abc8235b5211`::finished: {} >Thread-61::DEBUG::2013-12-12 10:31:22,658::task::579::TaskManager.Task::(_updateState) Task=`005a10d9-e515-4681-ba00-abc8235b5211`::moving from state preparing -> state finished >Thread-61::DEBUG::2013-12-12 10:31:22,658::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-61::DEBUG::2013-12-12 10:31:22,658::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-61::DEBUG::2013-12-12 10:31:22,659::task::974::TaskManager.Task::(_decref) Task=`005a10d9-e515-4681-ba00-abc8235b5211`::ref 0 aborting False >Thread-66::DEBUG::2013-12-12 10:31:32,695::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-66::DEBUG::2013-12-12 10:31:33,027::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-67::DEBUG::2013-12-12 10:31:33,043::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-67::DEBUG::2013-12-12 10:31:33,213::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '9a0e12c8-84e9-4960-968b-56fab71e014c', 'bricks': ['latest-a:/bricks/201312121030108991942637805', 'latest-a:/bricks/20131212103011341850249563', 'latest-a:/bricks/201312121030113411245056192', 'latest-b:/bricks/20131212103011341550199115', 'latest-b:/bricks/20131212103011341516730110', 'latest-b:/bricks/201312121030113411287551485', 'latest-b:/bricks/20131212103044648927299489', 'latest-a:/bricks/20131212103055374341374234', 'latest-b:/bricks/20131212103105683219930446', 'latest-a:/bricks/201312121031161431151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-69::DEBUG::2013-12-12 10:31:37,851::task::579::TaskManager.Task::(_updateState) Task=`fae38f8b-e284-43fd-a760-68989342f2f0`::moving from state init -> state preparing >Thread-69::INFO::2013-12-12 10:31:37,851::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-69::INFO::2013-12-12 10:31:37,851::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-69::DEBUG::2013-12-12 10:31:37,851::task::1168::TaskManager.Task::(prepare) Task=`fae38f8b-e284-43fd-a760-68989342f2f0`::finished: {} >Thread-69::DEBUG::2013-12-12 10:31:37,852::task::579::TaskManager.Task::(_updateState) Task=`fae38f8b-e284-43fd-a760-68989342f2f0`::moving from state preparing -> state finished >Thread-69::DEBUG::2013-12-12 10:31:37,852::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69::DEBUG::2013-12-12 10:31:37,852::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69::DEBUG::2013-12-12 10:31:37,852::task::974::TaskManager.Task::(_decref) Task=`fae38f8b-e284-43fd-a760-68989342f2f0`::ref 0 aborting False >Thread-72::DEBUG::2013-12-12 10:31:43,781::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-72::DEBUG::2013-12-12 10:31:44,125::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-74::DEBUG::2013-12-12 10:31:44,133::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-74::DEBUG::2013-12-12 10:31:44,300::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '9a0e12c8-84e9-4960-968b-56fab71e014c', 'bricks': ['latest-a:/bricks/201312121030108991942637805', 'latest-a:/bricks/20131212103011341850249563', 'latest-a:/bricks/201312121030113411245056192', 'latest-b:/bricks/20131212103011341550199115', 'latest-b:/bricks/20131212103011341516730110', 'latest-b:/bricks/201312121030113411287551485', 'latest-b:/bricks/20131212103044648927299489', 'latest-a:/bricks/20131212103055374341374234', 'latest-b:/bricks/20131212103105683219930446', 'latest-a:/bricks/201312121031161431151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-77::DEBUG::2013-12-12 10:31:52,950::task::579::TaskManager.Task::(_updateState) Task=`a238ae58-eab1-41d9-bff3-627e964b042e`::moving from state init -> state preparing >Thread-77::INFO::2013-12-12 10:31:52,950::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-77::INFO::2013-12-12 10:31:52,950::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-77::DEBUG::2013-12-12 10:31:52,950::task::1168::TaskManager.Task::(prepare) Task=`a238ae58-eab1-41d9-bff3-627e964b042e`::finished: {} >Thread-77::DEBUG::2013-12-12 10:31:52,950::task::579::TaskManager.Task::(_updateState) Task=`a238ae58-eab1-41d9-bff3-627e964b042e`::moving from state preparing -> state finished >Thread-77::DEBUG::2013-12-12 10:31:52,950::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-77::DEBUG::2013-12-12 10:31:52,951::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-77::DEBUG::2013-12-12 10:31:52,951::task::974::TaskManager.Task::(_decref) Task=`a238ae58-eab1-41d9-bff3-627e964b042e`::ref 0 aborting False >Thread-80::DEBUG::2013-12-12 10:31:57,070::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeStop with ('StartMigrationDuringRebalanceTest', False) {} flowID [3f8574c6] >Thread-80::DEBUG::2013-12-12 10:32:07,302::BindingXMLRPC::991::vds::(wrapper) return volumeStop with {'status': {'message': 'Done', 'code': 0}} >Thread-84::DEBUG::2013-12-12 10:32:08,066::task::579::TaskManager.Task::(_updateState) Task=`07dbda6e-17df-4d07-aae5-63a544edb05a`::moving from state init -> state preparing >Thread-84::INFO::2013-12-12 10:32:08,066::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-84::INFO::2013-12-12 10:32:08,066::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-84::DEBUG::2013-12-12 10:32:08,066::task::1168::TaskManager.Task::(prepare) Task=`07dbda6e-17df-4d07-aae5-63a544edb05a`::finished: {} >Thread-84::DEBUG::2013-12-12 10:32:08,066::task::579::TaskManager.Task::(_updateState) Task=`07dbda6e-17df-4d07-aae5-63a544edb05a`::moving from state preparing -> state finished >Thread-84::DEBUG::2013-12-12 10:32:08,067::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84::DEBUG::2013-12-12 10:32:08,067::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84::DEBUG::2013-12-12 10:32:08,067::task::974::TaskManager.Task::(_decref) Task=`07dbda6e-17df-4d07-aae5-63a544edb05a`::ref 0 aborting False >Thread-89::DEBUG::2013-12-12 10:32:18,923::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-89::DEBUG::2013-12-12 10:32:19,286::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-90::DEBUG::2013-12-12 10:32:19,296::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-90::DEBUG::2013-12-12 10:32:19,614::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '9a0e12c8-84e9-4960-968b-56fab71e014c', 'bricks': ['latest-a:/bricks/201312121030108991942637805', 'latest-a:/bricks/20131212103011341850249563', 'latest-a:/bricks/201312121030113411245056192', 'latest-b:/bricks/20131212103011341550199115', 'latest-b:/bricks/20131212103011341516730110', 'latest-b:/bricks/201312121030113411287551485', 'latest-b:/bricks/20131212103044648927299489', 'latest-a:/bricks/20131212103055374341374234', 'latest-b:/bricks/20131212103105683219930446', 'latest-a:/bricks/201312121031161431151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {}}}} >Thread-92::DEBUG::2013-12-12 10:32:23,192::task::579::TaskManager.Task::(_updateState) Task=`e4c4a46a-e0c7-4f69-9cae-66306f4f60c7`::moving from state init -> state preparing >Thread-92::INFO::2013-12-12 10:32:23,193::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-92::INFO::2013-12-12 10:32:23,193::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-92::DEBUG::2013-12-12 10:32:23,193::task::1168::TaskManager.Task::(prepare) Task=`e4c4a46a-e0c7-4f69-9cae-66306f4f60c7`::finished: {} >Thread-92::DEBUG::2013-12-12 10:32:23,193::task::579::TaskManager.Task::(_updateState) Task=`e4c4a46a-e0c7-4f69-9cae-66306f4f60c7`::moving from state preparing -> state finished >Thread-92::DEBUG::2013-12-12 10:32:23,193::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-92::DEBUG::2013-12-12 10:32:23,194::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-92::DEBUG::2013-12-12 10:32:23,194::task::974::TaskManager.Task::(_decref) Task=`e4c4a46a-e0c7-4f69-9cae-66306f4f60c7`::ref 0 aborting False >Thread-94::DEBUG::2013-12-12 10:32:24,644::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-94::DEBUG::2013-12-12 10:32:25,195::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-95::DEBUG::2013-12-12 10:32:25,204::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-95::DEBUG::2013-12-12 10:32:25,371::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '9a0e12c8-84e9-4960-968b-56fab71e014c', 'bricks': ['latest-a:/bricks/201312121030108991942637805', 'latest-a:/bricks/20131212103011341850249563', 'latest-a:/bricks/201312121030113411245056192', 'latest-b:/bricks/20131212103011341550199115', 'latest-b:/bricks/20131212103011341516730110', 'latest-b:/bricks/201312121030113411287551485', 'latest-b:/bricks/20131212103044648927299489', 'latest-a:/bricks/20131212103055374341374234', 'latest-b:/bricks/20131212103105683219930446', 'latest-a:/bricks/201312121031161431151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {}}}} >Thread-100::DEBUG::2013-12-12 10:32:38,406::task::579::TaskManager.Task::(_updateState) Task=`ca6448db-f204-447a-883d-0a0b0c1f56e5`::moving from state init -> state preparing >Thread-100::INFO::2013-12-12 10:32:38,406::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-100::INFO::2013-12-12 10:32:38,406::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-100::DEBUG::2013-12-12 10:32:38,407::task::1168::TaskManager.Task::(prepare) Task=`ca6448db-f204-447a-883d-0a0b0c1f56e5`::finished: {} >Thread-100::DEBUG::2013-12-12 10:32:38,407::task::579::TaskManager.Task::(_updateState) Task=`ca6448db-f204-447a-883d-0a0b0c1f56e5`::moving from state preparing -> state finished >Thread-100::DEBUG::2013-12-12 10:32:38,407::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-100::DEBUG::2013-12-12 10:32:38,407::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-100::DEBUG::2013-12-12 10:32:38,407::task::974::TaskManager.Task::(_decref) Task=`ca6448db-f204-447a-883d-0a0b0c1f56e5`::ref 0 aborting False >Thread-103::DEBUG::2013-12-12 10:32:42,154::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-103::DEBUG::2013-12-12 10:32:42,810::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-104::DEBUG::2013-12-12 10:32:42,818::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-104::DEBUG::2013-12-12 10:32:43,004::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '9a0e12c8-84e9-4960-968b-56fab71e014c', 'bricks': ['latest-a:/bricks/201312121030108991942637805', 'latest-a:/bricks/20131212103011341850249563', 'latest-a:/bricks/201312121030113411245056192', 'latest-b:/bricks/20131212103011341550199115', 'latest-b:/bricks/20131212103011341516730110', 'latest-b:/bricks/201312121030113411287551485', 'latest-b:/bricks/20131212103044648927299489', 'latest-a:/bricks/20131212103055374341374234', 'latest-b:/bricks/20131212103105683219930446', 'latest-a:/bricks/201312121031161431151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {}}}} >Thread-107::DEBUG::2013-12-12 10:32:48,025::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-107::DEBUG::2013-12-12 10:32:48,715::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-108::DEBUG::2013-12-12 10:32:48,723::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-108::DEBUG::2013-12-12 10:32:48,890::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '9a0e12c8-84e9-4960-968b-56fab71e014c', 'bricks': ['latest-a:/bricks/201312121030108991942637805', 'latest-a:/bricks/20131212103011341850249563', 'latest-a:/bricks/201312121030113411245056192', 'latest-b:/bricks/20131212103011341550199115', 'latest-b:/bricks/20131212103011341516730110', 'latest-b:/bricks/201312121030113411287551485', 'latest-b:/bricks/20131212103044648927299489', 'latest-a:/bricks/20131212103055374341374234', 'latest-b:/bricks/20131212103105683219930446', 'latest-a:/bricks/201312121031161431151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {}}}} >Thread-110::DEBUG::2013-12-12 10:32:53,503::task::579::TaskManager.Task::(_updateState) Task=`f09d0aca-dffa-465f-92be-321d823c4059`::moving from state init -> state preparing >Thread-110::INFO::2013-12-12 10:32:53,503::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-110::INFO::2013-12-12 10:32:53,503::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-110::DEBUG::2013-12-12 10:32:53,503::task::1168::TaskManager.Task::(prepare) Task=`f09d0aca-dffa-465f-92be-321d823c4059`::finished: {} >Thread-110::DEBUG::2013-12-12 10:32:53,503::task::579::TaskManager.Task::(_updateState) Task=`f09d0aca-dffa-465f-92be-321d823c4059`::moving from state preparing -> state finished >Thread-110::DEBUG::2013-12-12 10:32:53,504::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-110::DEBUG::2013-12-12 10:32:53,504::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-110::DEBUG::2013-12-12 10:32:53,504::task::974::TaskManager.Task::(_decref) Task=`f09d0aca-dffa-465f-92be-321d823c4059`::ref 0 aborting False >Thread-114::DEBUG::2013-12-12 10:32:59,656::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-114::DEBUG::2013-12-12 10:33:00,303::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-115::DEBUG::2013-12-12 10:33:00,316::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-115::DEBUG::2013-12-12 10:33:00,593::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '9a0e12c8-84e9-4960-968b-56fab71e014c', 'bricks': ['latest-a:/bricks/201312121030108991942637805', 'latest-a:/bricks/20131212103011341850249563', 'latest-a:/bricks/201312121030113411245056192', 'latest-b:/bricks/20131212103011341550199115', 'latest-b:/bricks/20131212103011341516730110', 'latest-b:/bricks/201312121030113411287551485', 'latest-b:/bricks/20131212103044648927299489', 'latest-a:/bricks/20131212103055374341374234', 'latest-b:/bricks/20131212103105683219930446', 'latest-a:/bricks/201312121031161431151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {}}}} >Thread-117::DEBUG::2013-12-12 10:33:05,070::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeStart with ('StartMigrationDuringRebalanceTest', False) {} flowID [6baf8456] >Thread-117::ERROR::2013-12-12 10:33:05,329::BindingXMLRPC::1000::vds::(wrapper) vdsm exception occured >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 989, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 53, in wrapper > rv = func(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 89, in volumeStart > self.svdsmProxy.glusterVolumeStart(volumeName, force) > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in glusterVolumeStart > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >GlusterVolumeStartFailedException: Volume start failed >error: volume start: StartMigrationDuringRebalanceTest: failed: Commit failed on localhost. Please check the log file for more details. >return code: 1 >Thread-119::DEBUG::2013-12-12 10:33:05,614::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-119::DEBUG::2013-12-12 10:33:06,217::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-120::DEBUG::2013-12-12 10:33:06,228::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-120::DEBUG::2013-12-12 10:33:06,432::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '9a0e12c8-84e9-4960-968b-56fab71e014c', 'bricks': ['latest-a:/bricks/201312121030108991942637805', 'latest-a:/bricks/20131212103011341850249563', 'latest-a:/bricks/201312121030113411245056192', 'latest-b:/bricks/20131212103011341550199115', 'latest-b:/bricks/20131212103011341516730110', 'latest-b:/bricks/201312121030113411287551485', 'latest-b:/bricks/20131212103044648927299489', 'latest-a:/bricks/20131212103055374341374234', 'latest-b:/bricks/20131212103105683219930446', 'latest-a:/bricks/201312121031161431151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {}}}} >Thread-121::DEBUG::2013-12-12 10:33:08,603::task::579::TaskManager.Task::(_updateState) Task=`979e631f-4506-4c28-8937-8ae08dee89ee`::moving from state init -> state preparing >Thread-121::INFO::2013-12-12 10:33:08,603::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-121::INFO::2013-12-12 10:33:08,604::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-121::DEBUG::2013-12-12 10:33:08,604::task::1168::TaskManager.Task::(prepare) Task=`979e631f-4506-4c28-8937-8ae08dee89ee`::finished: {} >Thread-121::DEBUG::2013-12-12 10:33:08,604::task::579::TaskManager.Task::(_updateState) Task=`979e631f-4506-4c28-8937-8ae08dee89ee`::moving from state preparing -> state finished >Thread-121::DEBUG::2013-12-12 10:33:08,604::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-121::DEBUG::2013-12-12 10:33:08,604::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-121::DEBUG::2013-12-12 10:33:08,604::task::974::TaskManager.Task::(_decref) Task=`979e631f-4506-4c28-8937-8ae08dee89ee`::ref 0 aborting False >Thread-123::DEBUG::2013-12-12 10:33:11,461::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-123::DEBUG::2013-12-12 10:33:11,900::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-125::DEBUG::2013-12-12 10:33:11,908::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-125::DEBUG::2013-12-12 10:33:12,077::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '9a0e12c8-84e9-4960-968b-56fab71e014c', 'bricks': ['latest-a:/bricks/201312121030108991942637805', 'latest-a:/bricks/20131212103011341850249563', 'latest-a:/bricks/201312121030113411245056192', 'latest-b:/bricks/20131212103011341550199115', 'latest-b:/bricks/20131212103011341516730110', 'latest-b:/bricks/201312121030113411287551485', 'latest-b:/bricks/20131212103044648927299489', 'latest-a:/bricks/20131212103055374341374234', 'latest-b:/bricks/20131212103105683219930446', 'latest-a:/bricks/201312121031161431151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {}}}} >Thread-127::DEBUG::2013-12-12 10:33:17,101::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-127::DEBUG::2013-12-12 10:33:17,498::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-128::DEBUG::2013-12-12 10:33:17,506::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-128::DEBUG::2013-12-12 10:33:17,880::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '9a0e12c8-84e9-4960-968b-56fab71e014c', 'bricks': ['latest-a:/bricks/201312121030108991942637805', 'latest-a:/bricks/20131212103011341850249563', 'latest-a:/bricks/201312121030113411245056192', 'latest-b:/bricks/20131212103011341550199115', 'latest-b:/bricks/20131212103011341516730110', 'latest-b:/bricks/201312121030113411287551485', 'latest-b:/bricks/20131212103044648927299489', 'latest-a:/bricks/20131212103055374341374234', 'latest-b:/bricks/20131212103105683219930446', 'latest-a:/bricks/201312121031161431151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {}}}} >Thread-131::DEBUG::2013-12-12 10:33:22,904::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-131::DEBUG::2013-12-12 10:33:23,243::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-132::DEBUG::2013-12-12 10:33:23,252::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-132::DEBUG::2013-12-12 10:33:23,472::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '9a0e12c8-84e9-4960-968b-56fab71e014c', 'bricks': ['latest-a:/bricks/201312121030108991942637805', 'latest-a:/bricks/20131212103011341850249563', 'latest-a:/bricks/201312121030113411245056192', 'latest-b:/bricks/20131212103011341550199115', 'latest-b:/bricks/20131212103011341516730110', 'latest-b:/bricks/201312121030113411287551485', 'latest-b:/bricks/20131212103044648927299489', 'latest-a:/bricks/20131212103055374341374234', 'latest-b:/bricks/20131212103105683219930446', 'latest-a:/bricks/201312121031161431151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {}}}} >Thread-133::DEBUG::2013-12-12 10:33:23,736::task::579::TaskManager.Task::(_updateState) Task=`010c3627-3172-4778-b496-8e16d14d7183`::moving from state init -> state preparing >Thread-133::INFO::2013-12-12 10:33:23,736::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-133::INFO::2013-12-12 10:33:23,736::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-133::DEBUG::2013-12-12 10:33:23,736::task::1168::TaskManager.Task::(prepare) Task=`010c3627-3172-4778-b496-8e16d14d7183`::finished: {} >Thread-133::DEBUG::2013-12-12 10:33:23,736::task::579::TaskManager.Task::(_updateState) Task=`010c3627-3172-4778-b496-8e16d14d7183`::moving from state preparing -> state finished >Thread-133::DEBUG::2013-12-12 10:33:23,736::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-133::DEBUG::2013-12-12 10:33:23,737::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-133::DEBUG::2013-12-12 10:33:23,737::task::974::TaskManager.Task::(_decref) Task=`010c3627-3172-4778-b496-8e16d14d7183`::ref 0 aborting False >Thread-136::DEBUG::2013-12-12 10:33:28,493::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} flowID [23745252] >Thread-136::DEBUG::2013-12-12 10:33:29,207::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-137::DEBUG::2013-12-12 10:33:29,215::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} flowID [23745252] >Thread-137::DEBUG::2013-12-12 10:33:29,382::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '9a0e12c8-84e9-4960-968b-56fab71e014c', 'bricks': ['latest-a:/bricks/201312121030108991942637805', 'latest-a:/bricks/20131212103011341850249563', 'latest-a:/bricks/201312121030113411245056192', 'latest-b:/bricks/20131212103011341550199115', 'latest-b:/bricks/20131212103011341516730110', 'latest-b:/bricks/201312121030113411287551485', 'latest-b:/bricks/20131212103044648927299489', 'latest-a:/bricks/20131212103055374341374234', 'latest-b:/bricks/20131212103105683219930446', 'latest-a:/bricks/201312121031161431151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {}}}} >Thread-140::DEBUG::2013-12-12 10:33:34,410::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-140::DEBUG::2013-12-12 10:33:35,094::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-141::DEBUG::2013-12-12 10:33:35,103::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-141::DEBUG::2013-12-12 10:33:35,311::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '9a0e12c8-84e9-4960-968b-56fab71e014c', 'bricks': ['latest-a:/bricks/201312121030108991942637805', 'latest-a:/bricks/20131212103011341850249563', 'latest-a:/bricks/201312121030113411245056192', 'latest-b:/bricks/20131212103011341550199115', 'latest-b:/bricks/20131212103011341516730110', 'latest-b:/bricks/201312121030113411287551485', 'latest-b:/bricks/20131212103044648927299489', 'latest-a:/bricks/20131212103055374341374234', 'latest-b:/bricks/20131212103105683219930446', 'latest-a:/bricks/201312121031161431151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {}}}} >Thread-143::DEBUG::2013-12-12 10:33:38,841::task::579::TaskManager.Task::(_updateState) Task=`cd29352c-095e-4055-89cf-ee70481cd25d`::moving from state init -> state preparing >Thread-143::INFO::2013-12-12 10:33:38,841::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-143::INFO::2013-12-12 10:33:38,842::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-143::DEBUG::2013-12-12 10:33:38,842::task::1168::TaskManager.Task::(prepare) Task=`cd29352c-095e-4055-89cf-ee70481cd25d`::finished: {} >Thread-143::DEBUG::2013-12-12 10:33:38,842::task::579::TaskManager.Task::(_updateState) Task=`cd29352c-095e-4055-89cf-ee70481cd25d`::moving from state preparing -> state finished >Thread-143::DEBUG::2013-12-12 10:33:38,842::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-143::DEBUG::2013-12-12 10:33:38,842::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-143::DEBUG::2013-12-12 10:33:38,842::task::974::TaskManager.Task::(_decref) Task=`cd29352c-095e-4055-89cf-ee70481cd25d`::ref 0 aborting False >Thread-147::DEBUG::2013-12-12 10:33:45,953::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-147::DEBUG::2013-12-12 10:33:46,298::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-148::DEBUG::2013-12-12 10:33:46,309::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-148::DEBUG::2013-12-12 10:33:46,477::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '9a0e12c8-84e9-4960-968b-56fab71e014c', 'bricks': ['latest-a:/bricks/201312121030108991942637805', 'latest-a:/bricks/20131212103011341850249563', 'latest-a:/bricks/201312121030113411245056192', 'latest-b:/bricks/20131212103011341550199115', 'latest-b:/bricks/20131212103011341516730110', 'latest-b:/bricks/201312121030113411287551485', 'latest-b:/bricks/20131212103044648927299489', 'latest-a:/bricks/20131212103055374341374234', 'latest-b:/bricks/20131212103105683219930446', 'latest-a:/bricks/201312121031161431151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {}}}} >Thread-151::DEBUG::2013-12-12 10:33:54,027::task::579::TaskManager.Task::(_updateState) Task=`9b6ff8e3-4101-4b0b-bf22-b9fda4f89413`::moving from state init -> state preparing >Thread-151::INFO::2013-12-12 10:33:54,027::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-151::INFO::2013-12-12 10:33:54,027::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-151::DEBUG::2013-12-12 10:33:54,027::task::1168::TaskManager.Task::(prepare) Task=`9b6ff8e3-4101-4b0b-bf22-b9fda4f89413`::finished: {} >Thread-151::DEBUG::2013-12-12 10:33:54,027::task::579::TaskManager.Task::(_updateState) Task=`9b6ff8e3-4101-4b0b-bf22-b9fda4f89413`::moving from state preparing -> state finished >Thread-151::DEBUG::2013-12-12 10:33:54,027::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-151::DEBUG::2013-12-12 10:33:54,028::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-151::DEBUG::2013-12-12 10:33:54,028::task::974::TaskManager.Task::(_decref) Task=`9b6ff8e3-4101-4b0b-bf22-b9fda4f89413`::ref 0 aborting False >Thread-157::DEBUG::2013-12-12 10:34:09,146::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-158::DEBUG::2013-12-12 10:34:09,312::task::579::TaskManager.Task::(_updateState) Task=`be5a17c9-8482-4749-bf71-9989f577ea4d`::moving from state init -> state preparing >Thread-158::INFO::2013-12-12 10:34:09,313::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-158::INFO::2013-12-12 10:34:09,313::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-158::DEBUG::2013-12-12 10:34:09,313::task::1168::TaskManager.Task::(prepare) Task=`be5a17c9-8482-4749-bf71-9989f577ea4d`::finished: {} >Thread-158::DEBUG::2013-12-12 10:34:09,313::task::579::TaskManager.Task::(_updateState) Task=`be5a17c9-8482-4749-bf71-9989f577ea4d`::moving from state preparing -> state finished >Thread-158::DEBUG::2013-12-12 10:34:09,313::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-158::DEBUG::2013-12-12 10:34:09,314::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-158::DEBUG::2013-12-12 10:34:09,314::task::974::TaskManager.Task::(_decref) Task=`be5a17c9-8482-4749-bf71-9989f577ea4d`::ref 0 aborting False >Thread-157::DEBUG::2013-12-12 10:34:09,567::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-160::DEBUG::2013-12-12 10:34:09,574::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-160::DEBUG::2013-12-12 10:34:09,748::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '9a0e12c8-84e9-4960-968b-56fab71e014c', 'bricks': ['latest-a:/bricks/201312121030108991942637805', 'latest-a:/bricks/20131212103011341850249563', 'latest-a:/bricks/201312121030113411245056192', 'latest-b:/bricks/20131212103011341550199115', 'latest-b:/bricks/20131212103011341516730110', 'latest-b:/bricks/201312121030113411287551485', 'latest-b:/bricks/20131212103044648927299489', 'latest-a:/bricks/20131212103055374341374234', 'latest-b:/bricks/20131212103105683219930446', 'latest-a:/bricks/201312121031161431151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {}}}} >Thread-162::DEBUG::2013-12-12 10:34:14,770::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-162::DEBUG::2013-12-12 10:34:15,338::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-163::DEBUG::2013-12-12 10:34:15,348::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-163::DEBUG::2013-12-12 10:34:15,574::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '9a0e12c8-84e9-4960-968b-56fab71e014c', 'bricks': ['latest-a:/bricks/201312121030108991942637805', 'latest-a:/bricks/20131212103011341850249563', 'latest-a:/bricks/201312121030113411245056192', 'latest-b:/bricks/20131212103011341550199115', 'latest-b:/bricks/20131212103011341516730110', 'latest-b:/bricks/201312121030113411287551485', 'latest-b:/bricks/20131212103044648927299489', 'latest-a:/bricks/20131212103055374341374234', 'latest-b:/bricks/20131212103105683219930446', 'latest-a:/bricks/201312121031161431151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {}}}} >Thread-166::DEBUG::2013-12-12 10:34:20,601::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} flowID [7c294d8a] >Thread-166::DEBUG::2013-12-12 10:34:21,062::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-167::DEBUG::2013-12-12 10:34:21,071::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} flowID [7c294d8a] >Thread-167::DEBUG::2013-12-12 10:34:21,292::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '9a0e12c8-84e9-4960-968b-56fab71e014c', 'bricks': ['latest-a:/bricks/201312121030108991942637805', 'latest-a:/bricks/20131212103011341850249563', 'latest-a:/bricks/201312121030113411245056192', 'latest-b:/bricks/20131212103011341550199115', 'latest-b:/bricks/20131212103011341516730110', 'latest-b:/bricks/201312121030113411287551485', 'latest-b:/bricks/20131212103044648927299489', 'latest-a:/bricks/20131212103055374341374234', 'latest-b:/bricks/20131212103105683219930446', 'latest-a:/bricks/201312121031161431151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {}}}} >Thread-169::DEBUG::2013-12-12 10:34:24,414::task::579::TaskManager.Task::(_updateState) Task=`51ecc030-9852-40da-9fb9-4bbcb2a3b200`::moving from state init -> state preparing >Thread-169::INFO::2013-12-12 10:34:24,414::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-169::INFO::2013-12-12 10:34:24,415::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-169::DEBUG::2013-12-12 10:34:24,415::task::1168::TaskManager.Task::(prepare) Task=`51ecc030-9852-40da-9fb9-4bbcb2a3b200`::finished: {} >Thread-169::DEBUG::2013-12-12 10:34:24,415::task::579::TaskManager.Task::(_updateState) Task=`51ecc030-9852-40da-9fb9-4bbcb2a3b200`::moving from state preparing -> state finished >Thread-169::DEBUG::2013-12-12 10:34:24,415::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-169::DEBUG::2013-12-12 10:34:24,415::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-169::DEBUG::2013-12-12 10:34:24,416::task::974::TaskManager.Task::(_decref) Task=`51ecc030-9852-40da-9fb9-4bbcb2a3b200`::ref 0 aborting False >Thread-173::DEBUG::2013-12-12 10:34:31,958::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-173::DEBUG::2013-12-12 10:34:32,401::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-174::DEBUG::2013-12-12 10:34:32,410::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-174::DEBUG::2013-12-12 10:34:32,580::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '9a0e12c8-84e9-4960-968b-56fab71e014c', 'bricks': ['latest-a:/bricks/201312121030108991942637805', 'latest-a:/bricks/20131212103011341850249563', 'latest-a:/bricks/201312121030113411245056192', 'latest-b:/bricks/20131212103011341550199115', 'latest-b:/bricks/20131212103011341516730110', 'latest-b:/bricks/201312121030113411287551485', 'latest-b:/bricks/20131212103044648927299489', 'latest-a:/bricks/20131212103055374341374234', 'latest-b:/bricks/20131212103105683219930446', 'latest-a:/bricks/201312121031161431151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {}}}} >Thread-177::DEBUG::2013-12-12 10:34:37,605::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-177::DEBUG::2013-12-12 10:34:38,202::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-178::DEBUG::2013-12-12 10:34:38,209::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-178::DEBUG::2013-12-12 10:34:38,379::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '9a0e12c8-84e9-4960-968b-56fab71e014c', 'bricks': ['latest-a:/bricks/201312121030108991942637805', 'latest-a:/bricks/20131212103011341850249563', 'latest-a:/bricks/201312121030113411245056192', 'latest-b:/bricks/20131212103011341550199115', 'latest-b:/bricks/20131212103011341516730110', 'latest-b:/bricks/201312121030113411287551485', 'latest-b:/bricks/20131212103044648927299489', 'latest-a:/bricks/20131212103055374341374234', 'latest-b:/bricks/20131212103105683219930446', 'latest-a:/bricks/201312121031161431151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {}}}} >Thread-179::DEBUG::2013-12-12 10:34:39,529::task::579::TaskManager.Task::(_updateState) Task=`9312bfe0-559b-4612-aa87-4c094fd782fc`::moving from state init -> state preparing >Thread-179::INFO::2013-12-12 10:34:39,529::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-179::INFO::2013-12-12 10:34:39,529::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-179::DEBUG::2013-12-12 10:34:39,529::task::1168::TaskManager.Task::(prepare) Task=`9312bfe0-559b-4612-aa87-4c094fd782fc`::finished: {} >Thread-179::DEBUG::2013-12-12 10:34:39,529::task::579::TaskManager.Task::(_updateState) Task=`9312bfe0-559b-4612-aa87-4c094fd782fc`::moving from state preparing -> state finished >Thread-179::DEBUG::2013-12-12 10:34:39,530::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-179::DEBUG::2013-12-12 10:34:39,530::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-179::DEBUG::2013-12-12 10:34:39,530::task::974::TaskManager.Task::(_decref) Task=`9312bfe0-559b-4612-aa87-4c094fd782fc`::ref 0 aborting False >Thread-182::DEBUG::2013-12-12 10:34:43,401::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-182::DEBUG::2013-12-12 10:34:43,759::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-183::DEBUG::2013-12-12 10:34:43,766::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-183::DEBUG::2013-12-12 10:34:43,933::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '9a0e12c8-84e9-4960-968b-56fab71e014c', 'bricks': ['latest-a:/bricks/201312121030108991942637805', 'latest-a:/bricks/20131212103011341850249563', 'latest-a:/bricks/201312121030113411245056192', 'latest-b:/bricks/20131212103011341550199115', 'latest-b:/bricks/20131212103011341516730110', 'latest-b:/bricks/201312121030113411287551485', 'latest-b:/bricks/20131212103044648927299489', 'latest-a:/bricks/20131212103055374341374234', 'latest-b:/bricks/20131212103105683219930446', 'latest-a:/bricks/201312121031161431151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {}}}} >Thread-187::DEBUG::2013-12-12 10:34:54,633::task::579::TaskManager.Task::(_updateState) Task=`897c08dd-1529-4aba-846d-be22a1d6e5e5`::moving from state init -> state preparing >Thread-187::INFO::2013-12-12 10:34:54,634::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-187::INFO::2013-12-12 10:34:54,634::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-187::DEBUG::2013-12-12 10:34:54,634::task::1168::TaskManager.Task::(prepare) Task=`897c08dd-1529-4aba-846d-be22a1d6e5e5`::finished: {} >Thread-187::DEBUG::2013-12-12 10:34:54,634::task::579::TaskManager.Task::(_updateState) Task=`897c08dd-1529-4aba-846d-be22a1d6e5e5`::moving from state preparing -> state finished >Thread-187::DEBUG::2013-12-12 10:34:54,634::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-187::DEBUG::2013-12-12 10:34:54,634::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-187::DEBUG::2013-12-12 10:34:54,635::task::974::TaskManager.Task::(_decref) Task=`897c08dd-1529-4aba-846d-be22a1d6e5e5`::ref 0 aborting False >Thread-189::DEBUG::2013-12-12 10:34:54,848::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-189::DEBUG::2013-12-12 10:34:55,498::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-190::DEBUG::2013-12-12 10:34:55,506::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-190::DEBUG::2013-12-12 10:34:55,676::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '9a0e12c8-84e9-4960-968b-56fab71e014c', 'bricks': ['latest-a:/bricks/201312121030108991942637805', 'latest-a:/bricks/20131212103011341850249563', 'latest-a:/bricks/201312121030113411245056192', 'latest-b:/bricks/20131212103011341550199115', 'latest-b:/bricks/20131212103011341516730110', 'latest-b:/bricks/201312121030113411287551485', 'latest-b:/bricks/20131212103044648927299489', 'latest-a:/bricks/20131212103055374341374234', 'latest-b:/bricks/20131212103105683219930446', 'latest-a:/bricks/201312121031161431151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {}}}} >Thread-194::DEBUG::2013-12-12 10:35:06,697::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} flowID [4be577d1] >Thread-194::DEBUG::2013-12-12 10:35:07,072::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-196::DEBUG::2013-12-12 10:35:07,079::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} flowID [4be577d1] >Thread-196::DEBUG::2013-12-12 10:35:07,254::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '9a0e12c8-84e9-4960-968b-56fab71e014c', 'bricks': ['latest-a:/bricks/201312121030108991942637805', 'latest-a:/bricks/20131212103011341850249563', 'latest-a:/bricks/201312121030113411245056192', 'latest-b:/bricks/20131212103011341550199115', 'latest-b:/bricks/20131212103011341516730110', 'latest-b:/bricks/201312121030113411287551485', 'latest-b:/bricks/20131212103044648927299489', 'latest-a:/bricks/20131212103055374341374234', 'latest-b:/bricks/20131212103105683219930446', 'latest-a:/bricks/201312121031161431151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {}}}} >Thread-197::DEBUG::2013-12-12 10:35:09,725::task::579::TaskManager.Task::(_updateState) Task=`420e82dd-fb79-43fa-8bde-ddfece960314`::moving from state init -> state preparing >Thread-197::INFO::2013-12-12 10:35:09,725::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-197::INFO::2013-12-12 10:35:09,725::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-197::DEBUG::2013-12-12 10:35:09,725::task::1168::TaskManager.Task::(prepare) Task=`420e82dd-fb79-43fa-8bde-ddfece960314`::finished: {} >Thread-197::DEBUG::2013-12-12 10:35:09,726::task::579::TaskManager.Task::(_updateState) Task=`420e82dd-fb79-43fa-8bde-ddfece960314`::moving from state preparing -> state finished >Thread-197::DEBUG::2013-12-12 10:35:09,726::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-197::DEBUG::2013-12-12 10:35:09,726::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-197::DEBUG::2013-12-12 10:35:09,726::task::974::TaskManager.Task::(_decref) Task=`420e82dd-fb79-43fa-8bde-ddfece960314`::ref 0 aborting False >Thread-199::DEBUG::2013-12-12 10:35:12,459::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-199::DEBUG::2013-12-12 10:35:12,822::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-201::DEBUG::2013-12-12 10:35:12,832::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-201::DEBUG::2013-12-12 10:35:13,004::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-205::DEBUG::2013-12-12 10:35:23,957::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-205::DEBUG::2013-12-12 10:35:24,402::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-206::DEBUG::2013-12-12 10:35:24,410::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-206::DEBUG::2013-12-12 10:35:24,577::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-207::DEBUG::2013-12-12 10:35:24,834::task::579::TaskManager.Task::(_updateState) Task=`72882be4-6d3c-4a54-a343-ada9bf1e556d`::moving from state init -> state preparing >Thread-207::INFO::2013-12-12 10:35:24,834::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-207::INFO::2013-12-12 10:35:24,834::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-207::DEBUG::2013-12-12 10:35:24,835::task::1168::TaskManager.Task::(prepare) Task=`72882be4-6d3c-4a54-a343-ada9bf1e556d`::finished: {} >Thread-207::DEBUG::2013-12-12 10:35:24,835::task::579::TaskManager.Task::(_updateState) Task=`72882be4-6d3c-4a54-a343-ada9bf1e556d`::moving from state preparing -> state finished >Thread-207::DEBUG::2013-12-12 10:35:24,835::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-207::DEBUG::2013-12-12 10:35:24,835::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-207::DEBUG::2013-12-12 10:35:24,835::task::974::TaskManager.Task::(_decref) Task=`72882be4-6d3c-4a54-a343-ada9bf1e556d`::ref 0 aborting False >Thread-213::DEBUG::2013-12-12 10:35:39,932::task::579::TaskManager.Task::(_updateState) Task=`e0540703-d14c-4927-a746-51db19009379`::moving from state init -> state preparing >Thread-213::INFO::2013-12-12 10:35:39,932::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-213::INFO::2013-12-12 10:35:39,932::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-213::DEBUG::2013-12-12 10:35:39,932::task::1168::TaskManager.Task::(prepare) Task=`e0540703-d14c-4927-a746-51db19009379`::finished: {} >Thread-213::DEBUG::2013-12-12 10:35:39,933::task::579::TaskManager.Task::(_updateState) Task=`e0540703-d14c-4927-a746-51db19009379`::moving from state preparing -> state finished >Thread-213::DEBUG::2013-12-12 10:35:39,933::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-213::DEBUG::2013-12-12 10:35:39,933::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-213::DEBUG::2013-12-12 10:35:39,933::task::974::TaskManager.Task::(_decref) Task=`e0540703-d14c-4927-a746-51db19009379`::ref 0 aborting False >Thread-217::DEBUG::2013-12-12 10:35:46,801::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-217::DEBUG::2013-12-12 10:35:47,461::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-218::DEBUG::2013-12-12 10:35:47,469::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-218::DEBUG::2013-12-12 10:35:47,635::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-221::DEBUG::2013-12-12 10:35:55,135::task::579::TaskManager.Task::(_updateState) Task=`721048a6-4764-4701-acd6-ea44963bd281`::moving from state init -> state preparing >Thread-221::INFO::2013-12-12 10:35:55,135::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-221::INFO::2013-12-12 10:35:55,135::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-221::DEBUG::2013-12-12 10:35:55,135::task::1168::TaskManager.Task::(prepare) Task=`721048a6-4764-4701-acd6-ea44963bd281`::finished: {} >Thread-221::DEBUG::2013-12-12 10:35:55,136::task::579::TaskManager.Task::(_updateState) Task=`721048a6-4764-4701-acd6-ea44963bd281`::moving from state preparing -> state finished >Thread-221::DEBUG::2013-12-12 10:35:55,136::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221::DEBUG::2013-12-12 10:35:55,136::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221::DEBUG::2013-12-12 10:35:55,136::task::974::TaskManager.Task::(_decref) Task=`721048a6-4764-4701-acd6-ea44963bd281`::ref 0 aborting False >Thread-227::DEBUG::2013-12-12 10:36:10,718::task::579::TaskManager.Task::(_updateState) Task=`0a23ad7c-c580-4680-bae7-64e8529a4c6b`::moving from state init -> state preparing >Thread-227::INFO::2013-12-12 10:36:10,718::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-227::INFO::2013-12-12 10:36:10,718::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-227::DEBUG::2013-12-12 10:36:10,719::task::1168::TaskManager.Task::(prepare) Task=`0a23ad7c-c580-4680-bae7-64e8529a4c6b`::finished: {} >Thread-227::DEBUG::2013-12-12 10:36:10,719::task::579::TaskManager.Task::(_updateState) Task=`0a23ad7c-c580-4680-bae7-64e8529a4c6b`::moving from state preparing -> state finished >Thread-227::DEBUG::2013-12-12 10:36:10,719::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227::DEBUG::2013-12-12 10:36:10,719::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227::DEBUG::2013-12-12 10:36:10,719::task::974::TaskManager.Task::(_decref) Task=`0a23ad7c-c580-4680-bae7-64e8529a4c6b`::ref 0 aborting False >Thread-230::DEBUG::2013-12-12 10:36:16,203::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-230::DEBUG::2013-12-12 10:36:16,836::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-232::DEBUG::2013-12-12 10:36:16,846::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-232::DEBUG::2013-12-12 10:36:17,099::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-235::DEBUG::2013-12-12 10:36:25,809::task::579::TaskManager.Task::(_updateState) Task=`2960975f-9b69-43d6-9eb7-5def5f5bd812`::moving from state init -> state preparing >Thread-235::INFO::2013-12-12 10:36:25,810::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-235::INFO::2013-12-12 10:36:25,810::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-235::DEBUG::2013-12-12 10:36:25,810::task::1168::TaskManager.Task::(prepare) Task=`2960975f-9b69-43d6-9eb7-5def5f5bd812`::finished: {} >Thread-235::DEBUG::2013-12-12 10:36:25,810::task::579::TaskManager.Task::(_updateState) Task=`2960975f-9b69-43d6-9eb7-5def5f5bd812`::moving from state preparing -> state finished >Thread-235::DEBUG::2013-12-12 10:36:25,810::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-235::DEBUG::2013-12-12 10:36:25,810::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-235::DEBUG::2013-12-12 10:36:25,811::task::974::TaskManager.Task::(_decref) Task=`2960975f-9b69-43d6-9eb7-5def5f5bd812`::ref 0 aborting False >Thread-239::DEBUG::2013-12-12 10:36:33,334::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-239::DEBUG::2013-12-12 10:36:33,766::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-240::DEBUG::2013-12-12 10:36:33,774::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-240::DEBUG::2013-12-12 10:36:33,943::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-243::DEBUG::2013-12-12 10:36:38,222::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-243::DEBUG::2013-12-12 10:36:38,403::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-244::DEBUG::2013-12-12 10:36:40,910::task::579::TaskManager.Task::(_updateState) Task=`c88b2390-d0ac-40a9-9cc6-2e27e27c20a4`::moving from state init -> state preparing >Thread-244::INFO::2013-12-12 10:36:40,910::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-244::INFO::2013-12-12 10:36:40,911::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-244::DEBUG::2013-12-12 10:36:40,911::task::1168::TaskManager.Task::(prepare) Task=`c88b2390-d0ac-40a9-9cc6-2e27e27c20a4`::finished: {} >Thread-244::DEBUG::2013-12-12 10:36:40,911::task::579::TaskManager.Task::(_updateState) Task=`c88b2390-d0ac-40a9-9cc6-2e27e27c20a4`::moving from state preparing -> state finished >Thread-244::DEBUG::2013-12-12 10:36:40,911::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-244::DEBUG::2013-12-12 10:36:40,911::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-244::DEBUG::2013-12-12 10:36:40,911::task::974::TaskManager.Task::(_decref) Task=`c88b2390-d0ac-40a9-9cc6-2e27e27c20a4`::ref 0 aborting False >Thread-250::DEBUG::2013-12-12 10:36:56,010::task::579::TaskManager.Task::(_updateState) Task=`0bdc8e8b-bb3a-4232-b8fa-ee3dc2ec9ccb`::moving from state init -> state preparing >Thread-250::INFO::2013-12-12 10:36:56,010::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-250::INFO::2013-12-12 10:36:56,010::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-250::DEBUG::2013-12-12 10:36:56,010::task::1168::TaskManager.Task::(prepare) Task=`0bdc8e8b-bb3a-4232-b8fa-ee3dc2ec9ccb`::finished: {} >Thread-250::DEBUG::2013-12-12 10:36:56,011::task::579::TaskManager.Task::(_updateState) Task=`0bdc8e8b-bb3a-4232-b8fa-ee3dc2ec9ccb`::moving from state preparing -> state finished >Thread-250::DEBUG::2013-12-12 10:36:56,011::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-250::DEBUG::2013-12-12 10:36:56,011::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-250::DEBUG::2013-12-12 10:36:56,011::task::974::TaskManager.Task::(_decref) Task=`0bdc8e8b-bb3a-4232-b8fa-ee3dc2ec9ccb`::ref 0 aborting False >Thread-252::DEBUG::2013-12-12 10:36:56,225::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-252::DEBUG::2013-12-12 10:36:56,571::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-253::DEBUG::2013-12-12 10:36:56,580::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-253::DEBUG::2013-12-12 10:36:56,806::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-258::DEBUG::2013-12-12 10:37:11,106::task::579::TaskManager.Task::(_updateState) Task=`8770a2a1-b0db-4998-af77-7b12d23c7381`::moving from state init -> state preparing >Thread-258::INFO::2013-12-12 10:37:11,107::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-258::INFO::2013-12-12 10:37:11,107::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-258::DEBUG::2013-12-12 10:37:11,107::task::1168::TaskManager.Task::(prepare) Task=`8770a2a1-b0db-4998-af77-7b12d23c7381`::finished: {} >Thread-258::DEBUG::2013-12-12 10:37:11,107::task::579::TaskManager.Task::(_updateState) Task=`8770a2a1-b0db-4998-af77-7b12d23c7381`::moving from state preparing -> state finished >Thread-258::DEBUG::2013-12-12 10:37:11,107::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-258::DEBUG::2013-12-12 10:37:11,107::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-258::DEBUG::2013-12-12 10:37:11,108::task::974::TaskManager.Task::(_decref) Task=`8770a2a1-b0db-4998-af77-7b12d23c7381`::ref 0 aborting False >Thread-260::DEBUG::2013-12-12 10:37:12,971::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-260::DEBUG::2013-12-12 10:37:13,658::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-261::DEBUG::2013-12-12 10:37:13,667::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-261::DEBUG::2013-12-12 10:37:13,869::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-264::DEBUG::2013-12-12 10:37:18,885::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-264::DEBUG::2013-12-12 10:37:19,492::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-265::DEBUG::2013-12-12 10:37:19,504::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-265::DEBUG::2013-12-12 10:37:19,845::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-268::DEBUG::2013-12-12 10:37:24,858::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-268::DEBUG::2013-12-12 10:37:25,275::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-269::DEBUG::2013-12-12 10:37:25,286::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-269::DEBUG::2013-12-12 10:37:25,458::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-270::DEBUG::2013-12-12 10:37:26,206::task::579::TaskManager.Task::(_updateState) Task=`01f3dee7-04b5-4fa7-b313-18156d770143`::moving from state init -> state preparing >Thread-270::INFO::2013-12-12 10:37:26,206::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-270::INFO::2013-12-12 10:37:26,206::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-270::DEBUG::2013-12-12 10:37:26,206::task::1168::TaskManager.Task::(prepare) Task=`01f3dee7-04b5-4fa7-b313-18156d770143`::finished: {} >Thread-270::DEBUG::2013-12-12 10:37:26,206::task::579::TaskManager.Task::(_updateState) Task=`01f3dee7-04b5-4fa7-b313-18156d770143`::moving from state preparing -> state finished >Thread-270::DEBUG::2013-12-12 10:37:26,207::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-270::DEBUG::2013-12-12 10:37:26,207::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-270::DEBUG::2013-12-12 10:37:26,207::task::974::TaskManager.Task::(_decref) Task=`01f3dee7-04b5-4fa7-b313-18156d770143`::ref 0 aborting False >Thread-275::DEBUG::2013-12-12 10:37:36,069::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} flowID [4be577d1] >Thread-275::DEBUG::2013-12-12 10:37:36,463::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-276::DEBUG::2013-12-12 10:37:36,473::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} flowID [4be577d1] >Thread-276::DEBUG::2013-12-12 10:37:36,952::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-278::DEBUG::2013-12-12 10:37:38,419::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-278::DEBUG::2013-12-12 10:37:38,608::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-279::DEBUG::2013-12-12 10:37:41,317::task::579::TaskManager.Task::(_updateState) Task=`e93acd69-faaf-4403-a30e-28985c8c87c4`::moving from state init -> state preparing >Thread-279::INFO::2013-12-12 10:37:41,317::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-279::INFO::2013-12-12 10:37:41,317::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-279::DEBUG::2013-12-12 10:37:41,317::task::1168::TaskManager.Task::(prepare) Task=`e93acd69-faaf-4403-a30e-28985c8c87c4`::finished: {} >Thread-279::DEBUG::2013-12-12 10:37:41,317::task::579::TaskManager.Task::(_updateState) Task=`e93acd69-faaf-4403-a30e-28985c8c87c4`::moving from state preparing -> state finished >Thread-279::DEBUG::2013-12-12 10:37:41,317::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-279::DEBUG::2013-12-12 10:37:41,318::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-279::DEBUG::2013-12-12 10:37:41,318::task::974::TaskManager.Task::(_decref) Task=`e93acd69-faaf-4403-a30e-28985c8c87c4`::ref 0 aborting False >Thread-283::DEBUG::2013-12-12 10:37:47,648::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-283::DEBUG::2013-12-12 10:37:48,041::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-284::DEBUG::2013-12-12 10:37:48,054::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-284::DEBUG::2013-12-12 10:37:48,507::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-287::DEBUG::2013-12-12 10:37:56,475::task::579::TaskManager.Task::(_updateState) Task=`d67bd29d-8d58-4d60-a9ab-7d2cac95b83b`::moving from state init -> state preparing >Thread-287::INFO::2013-12-12 10:37:56,475::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287::INFO::2013-12-12 10:37:56,475::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-287::DEBUG::2013-12-12 10:37:56,475::task::1168::TaskManager.Task::(prepare) Task=`d67bd29d-8d58-4d60-a9ab-7d2cac95b83b`::finished: {} >Thread-287::DEBUG::2013-12-12 10:37:56,475::task::579::TaskManager.Task::(_updateState) Task=`d67bd29d-8d58-4d60-a9ab-7d2cac95b83b`::moving from state preparing -> state finished >Thread-287::DEBUG::2013-12-12 10:37:56,476::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287::DEBUG::2013-12-12 10:37:56,476::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287::DEBUG::2013-12-12 10:37:56,476::task::974::TaskManager.Task::(_decref) Task=`d67bd29d-8d58-4d60-a9ab-7d2cac95b83b`::ref 0 aborting False >Thread-289::DEBUG::2013-12-12 10:37:58,861::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeCreate with ('blah', ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 0, 0, ['TCP'], False) {} flowID [35353fc0] >Thread-289::DEBUG::2013-12-12 10:38:06,140::BindingXMLRPC::991::vds::(wrapper) return volumeCreate with {'status': {'message': 'Done', 'code': 0}, 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0'} >Thread-293::DEBUG::2013-12-12 10:38:06,311::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeSet with ('blah', 'nfs.disable', 'off') {} flowID [3dbdd3c9] >Thread-295::DEBUG::2013-12-12 10:38:11,620::task::579::TaskManager.Task::(_updateState) Task=`d688e405-8c89-4ad2-91ea-87adf012ff28`::moving from state init -> state preparing >Thread-295::INFO::2013-12-12 10:38:11,620::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-295::INFO::2013-12-12 10:38:11,621::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-295::DEBUG::2013-12-12 10:38:11,621::task::1168::TaskManager.Task::(prepare) Task=`d688e405-8c89-4ad2-91ea-87adf012ff28`::finished: {} >Thread-295::DEBUG::2013-12-12 10:38:11,621::task::579::TaskManager.Task::(_updateState) Task=`d688e405-8c89-4ad2-91ea-87adf012ff28`::moving from state preparing -> state finished >Thread-295::DEBUG::2013-12-12 10:38:11,621::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-295::DEBUG::2013-12-12 10:38:11,621::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-295::DEBUG::2013-12-12 10:38:11,621::task::974::TaskManager.Task::(_decref) Task=`d688e405-8c89-4ad2-91ea-87adf012ff28`::ref 0 aborting False >Thread-293::DEBUG::2013-12-12 10:38:12,497::BindingXMLRPC::991::vds::(wrapper) return volumeSet with {'status': {'message': 'Done', 'code': 0}} >Thread-297::DEBUG::2013-12-12 10:38:12,560::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeSet with ('blah', 'user.cifs', 'enable') {} flowID [15c57462] >Thread-297::DEBUG::2013-12-12 10:38:19,013::BindingXMLRPC::991::vds::(wrapper) return volumeSet with {'status': {'message': 'Done', 'code': 0}} >Thread-302::DEBUG::2013-12-12 10:38:25,917::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-302::DEBUG::2013-12-12 10:38:26,406::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-303::DEBUG::2013-12-12 10:38:26,416::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-303::DEBUG::2013-12-12 10:38:26,645::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-304::DEBUG::2013-12-12 10:38:26,756::task::579::TaskManager.Task::(_updateState) Task=`47a78a32-8a30-439b-a5c5-3f3fc4e7780a`::moving from state init -> state preparing >Thread-304::INFO::2013-12-12 10:38:26,756::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-304::INFO::2013-12-12 10:38:26,756::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-304::DEBUG::2013-12-12 10:38:26,756::task::1168::TaskManager.Task::(prepare) Task=`47a78a32-8a30-439b-a5c5-3f3fc4e7780a`::finished: {} >Thread-304::DEBUG::2013-12-12 10:38:26,756::task::579::TaskManager.Task::(_updateState) Task=`47a78a32-8a30-439b-a5c5-3f3fc4e7780a`::moving from state preparing -> state finished >Thread-304::DEBUG::2013-12-12 10:38:26,757::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-304::DEBUG::2013-12-12 10:38:26,757::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-304::DEBUG::2013-12-12 10:38:26,757::task::974::TaskManager.Task::(_decref) Task=`47a78a32-8a30-439b-a5c5-3f3fc4e7780a`::ref 0 aborting False >Thread-309::DEBUG::2013-12-12 10:38:37,282::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-309::DEBUG::2013-12-12 10:38:37,970::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-310::DEBUG::2013-12-12 10:38:37,979::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-310::DEBUG::2013-12-12 10:38:38,148::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-311::DEBUG::2013-12-12 10:38:38,618::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-311::DEBUG::2013-12-12 10:38:38,861::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-313::DEBUG::2013-12-12 10:38:41,856::task::579::TaskManager.Task::(_updateState) Task=`63e7a580-3390-458c-b09c-9786d0b2e57b`::moving from state init -> state preparing >Thread-313::INFO::2013-12-12 10:38:41,856::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-313::INFO::2013-12-12 10:38:41,856::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-313::DEBUG::2013-12-12 10:38:41,857::task::1168::TaskManager.Task::(prepare) Task=`63e7a580-3390-458c-b09c-9786d0b2e57b`::finished: {} >Thread-313::DEBUG::2013-12-12 10:38:41,857::task::579::TaskManager.Task::(_updateState) Task=`63e7a580-3390-458c-b09c-9786d0b2e57b`::moving from state preparing -> state finished >Thread-313::DEBUG::2013-12-12 10:38:41,857::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-313::DEBUG::2013-12-12 10:38:41,857::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-313::DEBUG::2013-12-12 10:38:41,857::task::974::TaskManager.Task::(_decref) Task=`63e7a580-3390-458c-b09c-9786d0b2e57b`::ref 0 aborting False >Thread-319::DEBUG::2013-12-12 10:38:54,810::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-319::DEBUG::2013-12-12 10:38:55,193::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-320::DEBUG::2013-12-12 10:38:55,200::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-320::DEBUG::2013-12-12 10:38:55,389::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-321::DEBUG::2013-12-12 10:38:57,098::task::579::TaskManager.Task::(_updateState) Task=`50daaf88-b47f-4866-8729-e68940622b3c`::moving from state init -> state preparing >Thread-321::INFO::2013-12-12 10:38:57,098::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-321::INFO::2013-12-12 10:38:57,099::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-321::DEBUG::2013-12-12 10:38:57,099::task::1168::TaskManager.Task::(prepare) Task=`50daaf88-b47f-4866-8729-e68940622b3c`::finished: {} >Thread-321::DEBUG::2013-12-12 10:38:57,099::task::579::TaskManager.Task::(_updateState) Task=`50daaf88-b47f-4866-8729-e68940622b3c`::moving from state preparing -> state finished >Thread-321::DEBUG::2013-12-12 10:38:57,099::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-321::DEBUG::2013-12-12 10:38:57,099::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-321::DEBUG::2013-12-12 10:38:57,100::task::974::TaskManager.Task::(_decref) Task=`50daaf88-b47f-4866-8729-e68940622b3c`::ref 0 aborting False >Thread-324::DEBUG::2013-12-12 10:39:00,407::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-324::DEBUG::2013-12-12 10:39:00,749::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-325::DEBUG::2013-12-12 10:39:00,756::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-325::DEBUG::2013-12-12 10:39:00,925::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-329::DEBUG::2013-12-12 10:39:11,939::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-330::DEBUG::2013-12-12 10:39:12,351::task::579::TaskManager.Task::(_updateState) Task=`f3a0a92a-3d05-4874-9b5a-8ed17cd6803b`::moving from state init -> state preparing >Thread-330::INFO::2013-12-12 10:39:12,351::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-330::INFO::2013-12-12 10:39:12,352::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-330::DEBUG::2013-12-12 10:39:12,352::task::1168::TaskManager.Task::(prepare) Task=`f3a0a92a-3d05-4874-9b5a-8ed17cd6803b`::finished: {} >Thread-330::DEBUG::2013-12-12 10:39:12,352::task::579::TaskManager.Task::(_updateState) Task=`f3a0a92a-3d05-4874-9b5a-8ed17cd6803b`::moving from state preparing -> state finished >Thread-330::DEBUG::2013-12-12 10:39:12,352::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-330::DEBUG::2013-12-12 10:39:12,352::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-330::DEBUG::2013-12-12 10:39:12,352::task::974::TaskManager.Task::(_decref) Task=`f3a0a92a-3d05-4874-9b5a-8ed17cd6803b`::ref 0 aborting False >Thread-329::DEBUG::2013-12-12 10:39:12,598::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-332::DEBUG::2013-12-12 10:39:12,606::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-332::DEBUG::2013-12-12 10:39:12,778::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-333::DEBUG::2013-12-12 10:39:12,835::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeStart with ('blah', False) {} flowID [54785663] >Thread-333::ERROR::2013-12-12 10:39:13,023::BindingXMLRPC::1000::vds::(wrapper) vdsm exception occured >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 989, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 53, in wrapper > rv = func(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 89, in volumeStart > self.svdsmProxy.glusterVolumeStart(volumeName, force) > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in glusterVolumeStart > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >GlusterVolumeStartFailedException: Volume start failed >error: volume start: blah: failed: Commit failed on localhost. Please check the log file for more details. >return code: 1 >Thread-335::DEBUG::2013-12-12 10:39:17,807::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-335::DEBUG::2013-12-12 10:39:18,501::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-337::DEBUG::2013-12-12 10:39:18,512::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-337::DEBUG::2013-12-12 10:39:18,699::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-340::DEBUG::2013-12-12 10:39:27,450::task::579::TaskManager.Task::(_updateState) Task=`c03b174a-fb8f-410f-aa50-3bfe247b0b02`::moving from state init -> state preparing >Thread-340::INFO::2013-12-12 10:39:27,451::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-340::INFO::2013-12-12 10:39:27,451::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-340::DEBUG::2013-12-12 10:39:27,451::task::1168::TaskManager.Task::(prepare) Task=`c03b174a-fb8f-410f-aa50-3bfe247b0b02`::finished: {} >Thread-340::DEBUG::2013-12-12 10:39:27,451::task::579::TaskManager.Task::(_updateState) Task=`c03b174a-fb8f-410f-aa50-3bfe247b0b02`::moving from state preparing -> state finished >Thread-340::DEBUG::2013-12-12 10:39:27,451::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-340::DEBUG::2013-12-12 10:39:27,451::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-340::DEBUG::2013-12-12 10:39:27,452::task::974::TaskManager.Task::(_decref) Task=`c03b174a-fb8f-410f-aa50-3bfe247b0b02`::ref 0 aborting False >Thread-342::DEBUG::2013-12-12 10:39:29,570::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-342::DEBUG::2013-12-12 10:39:29,978::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-343::DEBUG::2013-12-12 10:39:29,986::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-343::DEBUG::2013-12-12 10:39:30,155::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-346::DEBUG::2013-12-12 10:39:35,174::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-346::DEBUG::2013-12-12 10:39:35,518::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-347::DEBUG::2013-12-12 10:39:35,527::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-347::DEBUG::2013-12-12 10:39:35,701::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-350::DEBUG::2013-12-12 10:39:42,662::task::579::TaskManager.Task::(_updateState) Task=`294d8285-3d1c-4e7a-89ed-adf62c1a9816`::moving from state init -> state preparing >Thread-350::INFO::2013-12-12 10:39:42,662::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-350::INFO::2013-12-12 10:39:42,663::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-350::DEBUG::2013-12-12 10:39:42,663::task::1168::TaskManager.Task::(prepare) Task=`294d8285-3d1c-4e7a-89ed-adf62c1a9816`::finished: {} >Thread-350::DEBUG::2013-12-12 10:39:42,663::task::579::TaskManager.Task::(_updateState) Task=`294d8285-3d1c-4e7a-89ed-adf62c1a9816`::moving from state preparing -> state finished >Thread-350::DEBUG::2013-12-12 10:39:42,663::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-350::DEBUG::2013-12-12 10:39:42,663::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-350::DEBUG::2013-12-12 10:39:42,663::task::974::TaskManager.Task::(_decref) Task=`294d8285-3d1c-4e7a-89ed-adf62c1a9816`::ref 0 aborting False >Thread-355::DEBUG::2013-12-12 10:39:52,201::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-355::DEBUG::2013-12-12 10:39:52,570::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-356::DEBUG::2013-12-12 10:39:52,577::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-356::DEBUG::2013-12-12 10:39:52,806::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-358::DEBUG::2013-12-12 10:39:57,762::task::579::TaskManager.Task::(_updateState) Task=`8ce10e67-553b-462d-b791-f5da2f011137`::moving from state init -> state preparing >Thread-358::INFO::2013-12-12 10:39:57,762::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-358::INFO::2013-12-12 10:39:57,763::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-358::DEBUG::2013-12-12 10:39:57,763::task::1168::TaskManager.Task::(prepare) Task=`8ce10e67-553b-462d-b791-f5da2f011137`::finished: {} >Thread-358::DEBUG::2013-12-12 10:39:57,763::task::579::TaskManager.Task::(_updateState) Task=`8ce10e67-553b-462d-b791-f5da2f011137`::moving from state preparing -> state finished >Thread-358::DEBUG::2013-12-12 10:39:57,763::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-358::DEBUG::2013-12-12 10:39:57,763::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-358::DEBUG::2013-12-12 10:39:57,763::task::974::TaskManager.Task::(_decref) Task=`8ce10e67-553b-462d-b791-f5da2f011137`::ref 0 aborting False >Thread-364::DEBUG::2013-12-12 10:40:12,900::task::579::TaskManager.Task::(_updateState) Task=`fad0646e-9f67-46e2-9ce7-a303843e9030`::moving from state init -> state preparing >Thread-364::INFO::2013-12-12 10:40:12,900::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-364::INFO::2013-12-12 10:40:12,900::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-364::DEBUG::2013-12-12 10:40:12,900::task::1168::TaskManager.Task::(prepare) Task=`fad0646e-9f67-46e2-9ce7-a303843e9030`::finished: {} >Thread-364::DEBUG::2013-12-12 10:40:12,900::task::579::TaskManager.Task::(_updateState) Task=`fad0646e-9f67-46e2-9ce7-a303843e9030`::moving from state preparing -> state finished >Thread-364::DEBUG::2013-12-12 10:40:12,901::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-364::DEBUG::2013-12-12 10:40:12,901::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-364::DEBUG::2013-12-12 10:40:12,901::task::974::TaskManager.Task::(_decref) Task=`fad0646e-9f67-46e2-9ce7-a303843e9030`::ref 0 aborting False >Thread-368::DEBUG::2013-12-12 10:40:21,007::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-368::DEBUG::2013-12-12 10:40:21,732::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-369::DEBUG::2013-12-12 10:40:21,740::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-369::DEBUG::2013-12-12 10:40:21,905::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-372::DEBUG::2013-12-12 10:40:28,094::task::579::TaskManager.Task::(_updateState) Task=`d5e7e1d9-d0d0-4139-9cf9-b64e5bd78071`::moving from state init -> state preparing >Thread-372::INFO::2013-12-12 10:40:28,095::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-372::INFO::2013-12-12 10:40:28,095::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-372::DEBUG::2013-12-12 10:40:28,095::task::1168::TaskManager.Task::(prepare) Task=`d5e7e1d9-d0d0-4139-9cf9-b64e5bd78071`::finished: {} >Thread-372::DEBUG::2013-12-12 10:40:28,095::task::579::TaskManager.Task::(_updateState) Task=`d5e7e1d9-d0d0-4139-9cf9-b64e5bd78071`::moving from state preparing -> state finished >Thread-372::DEBUG::2013-12-12 10:40:28,095::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-372::DEBUG::2013-12-12 10:40:28,095::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-372::DEBUG::2013-12-12 10:40:28,096::task::974::TaskManager.Task::(_decref) Task=`d5e7e1d9-d0d0-4139-9cf9-b64e5bd78071`::ref 0 aborting False >Thread-375::DEBUG::2013-12-12 10:40:33,024::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-375::DEBUG::2013-12-12 10:40:33,530::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-376::DEBUG::2013-12-12 10:40:33,538::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-376::DEBUG::2013-12-12 10:40:33,747::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-380::DEBUG::2013-12-12 10:40:43,179::task::579::TaskManager.Task::(_updateState) Task=`bd314350-e00d-4f0d-9d1a-ac38198c6d7d`::moving from state init -> state preparing >Thread-380::INFO::2013-12-12 10:40:43,179::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-380::INFO::2013-12-12 10:40:43,179::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-380::DEBUG::2013-12-12 10:40:43,180::task::1168::TaskManager.Task::(prepare) Task=`bd314350-e00d-4f0d-9d1a-ac38198c6d7d`::finished: {} >Thread-380::DEBUG::2013-12-12 10:40:43,180::task::579::TaskManager.Task::(_updateState) Task=`bd314350-e00d-4f0d-9d1a-ac38198c6d7d`::moving from state preparing -> state finished >Thread-380::DEBUG::2013-12-12 10:40:43,180::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-380::DEBUG::2013-12-12 10:40:43,180::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-380::DEBUG::2013-12-12 10:40:43,180::task::974::TaskManager.Task::(_decref) Task=`bd314350-e00d-4f0d-9d1a-ac38198c6d7d`::ref 0 aborting False >Thread-382::DEBUG::2013-12-12 10:40:45,195::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-382::DEBUG::2013-12-12 10:40:45,601::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-383::DEBUG::2013-12-12 10:40:45,612::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-383::DEBUG::2013-12-12 10:40:45,985::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-386::DEBUG::2013-12-12 10:40:51,008::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-386::DEBUG::2013-12-12 10:40:51,340::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-387::DEBUG::2013-12-12 10:40:51,349::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-387::DEBUG::2013-12-12 10:40:51,592::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-390::DEBUG::2013-12-12 10:40:58,273::task::579::TaskManager.Task::(_updateState) Task=`edb9401c-639e-4523-a4de-e55eff09c4b0`::moving from state init -> state preparing >Thread-390::INFO::2013-12-12 10:40:58,273::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-390::INFO::2013-12-12 10:40:58,273::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-390::DEBUG::2013-12-12 10:40:58,274::task::1168::TaskManager.Task::(prepare) Task=`edb9401c-639e-4523-a4de-e55eff09c4b0`::finished: {} >Thread-390::DEBUG::2013-12-12 10:40:58,274::task::579::TaskManager.Task::(_updateState) Task=`edb9401c-639e-4523-a4de-e55eff09c4b0`::moving from state preparing -> state finished >Thread-390::DEBUG::2013-12-12 10:40:58,274::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-390::DEBUG::2013-12-12 10:40:58,274::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-390::DEBUG::2013-12-12 10:40:58,274::task::974::TaskManager.Task::(_decref) Task=`edb9401c-639e-4523-a4de-e55eff09c4b0`::ref 0 aborting False >Thread-396::DEBUG::2013-12-12 10:41:13,361::task::579::TaskManager.Task::(_updateState) Task=`ad79dc50-aabb-4d40-8411-4ca3da6ab61d`::moving from state init -> state preparing >Thread-396::INFO::2013-12-12 10:41:13,362::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-396::INFO::2013-12-12 10:41:13,362::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-396::DEBUG::2013-12-12 10:41:13,362::task::1168::TaskManager.Task::(prepare) Task=`ad79dc50-aabb-4d40-8411-4ca3da6ab61d`::finished: {} >Thread-396::DEBUG::2013-12-12 10:41:13,362::task::579::TaskManager.Task::(_updateState) Task=`ad79dc50-aabb-4d40-8411-4ca3da6ab61d`::moving from state preparing -> state finished >Thread-396::DEBUG::2013-12-12 10:41:13,362::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-396::DEBUG::2013-12-12 10:41:13,362::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-396::DEBUG::2013-12-12 10:41:13,363::task::974::TaskManager.Task::(_decref) Task=`ad79dc50-aabb-4d40-8411-4ca3da6ab61d`::ref 0 aborting False >Thread-398::DEBUG::2013-12-12 10:41:13,947::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-398::DEBUG::2013-12-12 10:41:14,321::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-399::DEBUG::2013-12-12 10:41:14,328::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-399::DEBUG::2013-12-12 10:41:14,526::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-403::DEBUG::2013-12-12 10:41:25,221::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-403::DEBUG::2013-12-12 10:41:25,860::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-405::DEBUG::2013-12-12 10:41:25,867::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-405::DEBUG::2013-12-12 10:41:26,073::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-406::DEBUG::2013-12-12 10:41:28,547::task::579::TaskManager.Task::(_updateState) Task=`48fd9c25-4933-4b7b-8b97-aa53690fc176`::moving from state init -> state preparing >Thread-406::INFO::2013-12-12 10:41:28,548::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-406::INFO::2013-12-12 10:41:28,548::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-406::DEBUG::2013-12-12 10:41:28,548::task::1168::TaskManager.Task::(prepare) Task=`48fd9c25-4933-4b7b-8b97-aa53690fc176`::finished: {} >Thread-406::DEBUG::2013-12-12 10:41:28,548::task::579::TaskManager.Task::(_updateState) Task=`48fd9c25-4933-4b7b-8b97-aa53690fc176`::moving from state preparing -> state finished >Thread-406::DEBUG::2013-12-12 10:41:28,548::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-406::DEBUG::2013-12-12 10:41:28,548::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-406::DEBUG::2013-12-12 10:41:28,549::task::974::TaskManager.Task::(_decref) Task=`48fd9c25-4933-4b7b-8b97-aa53690fc176`::ref 0 aborting False >Thread-408::DEBUG::2013-12-12 10:41:31,095::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-408::DEBUG::2013-12-12 10:41:31,504::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-409::DEBUG::2013-12-12 10:41:31,512::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-409::DEBUG::2013-12-12 10:41:31,748::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-414::DEBUG::2013-12-12 10:41:42,748::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-414::DEBUG::2013-12-12 10:41:43,137::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-415::DEBUG::2013-12-12 10:41:43,145::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-415::DEBUG::2013-12-12 10:41:43,480::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-416::DEBUG::2013-12-12 10:41:43,652::task::579::TaskManager.Task::(_updateState) Task=`7e6291ae-fbda-4721-ae59-0e269ba85971`::moving from state init -> state preparing >Thread-416::INFO::2013-12-12 10:41:43,652::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-416::INFO::2013-12-12 10:41:43,652::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-416::DEBUG::2013-12-12 10:41:43,652::task::1168::TaskManager.Task::(prepare) Task=`7e6291ae-fbda-4721-ae59-0e269ba85971`::finished: {} >Thread-416::DEBUG::2013-12-12 10:41:43,652::task::579::TaskManager.Task::(_updateState) Task=`7e6291ae-fbda-4721-ae59-0e269ba85971`::moving from state preparing -> state finished >Thread-416::DEBUG::2013-12-12 10:41:43,652::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-416::DEBUG::2013-12-12 10:41:43,653::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-416::DEBUG::2013-12-12 10:41:43,653::task::974::TaskManager.Task::(_decref) Task=`7e6291ae-fbda-4721-ae59-0e269ba85971`::ref 0 aborting False >Thread-419::DEBUG::2013-12-12 10:41:48,498::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-419::DEBUG::2013-12-12 10:41:49,061::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-420::DEBUG::2013-12-12 10:41:49,068::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-420::DEBUG::2013-12-12 10:41:49,234::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-424::DEBUG::2013-12-12 10:41:58,741::task::579::TaskManager.Task::(_updateState) Task=`88ca3e04-3dc2-4694-b9f7-999e97a9781d`::moving from state init -> state preparing >Thread-424::INFO::2013-12-12 10:41:58,742::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-424::INFO::2013-12-12 10:41:58,742::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-424::DEBUG::2013-12-12 10:41:58,742::task::1168::TaskManager.Task::(prepare) Task=`88ca3e04-3dc2-4694-b9f7-999e97a9781d`::finished: {} >Thread-424::DEBUG::2013-12-12 10:41:58,742::task::579::TaskManager.Task::(_updateState) Task=`88ca3e04-3dc2-4694-b9f7-999e97a9781d`::moving from state preparing -> state finished >Thread-424::DEBUG::2013-12-12 10:41:58,742::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-424::DEBUG::2013-12-12 10:41:58,742::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-424::DEBUG::2013-12-12 10:41:58,743::task::974::TaskManager.Task::(_decref) Task=`88ca3e04-3dc2-4694-b9f7-999e97a9781d`::ref 0 aborting False >Thread-426::DEBUG::2013-12-12 10:42:00,315::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-426::DEBUG::2013-12-12 10:42:00,860::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-427::DEBUG::2013-12-12 10:42:00,868::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-427::DEBUG::2013-12-12 10:42:01,038::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-432::DEBUG::2013-12-12 10:42:11,724::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-432::DEBUG::2013-12-12 10:42:12,160::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-433::DEBUG::2013-12-12 10:42:12,169::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-433::DEBUG::2013-12-12 10:42:12,399::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-434::DEBUG::2013-12-12 10:42:13,828::task::579::TaskManager.Task::(_updateState) Task=`3a649e3c-d297-4616-8964-99b72005ab75`::moving from state init -> state preparing >Thread-434::INFO::2013-12-12 10:42:13,828::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-434::INFO::2013-12-12 10:42:13,829::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-434::DEBUG::2013-12-12 10:42:13,829::task::1168::TaskManager.Task::(prepare) Task=`3a649e3c-d297-4616-8964-99b72005ab75`::finished: {} >Thread-434::DEBUG::2013-12-12 10:42:13,829::task::579::TaskManager.Task::(_updateState) Task=`3a649e3c-d297-4616-8964-99b72005ab75`::moving from state preparing -> state finished >Thread-434::DEBUG::2013-12-12 10:42:13,829::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-434::DEBUG::2013-12-12 10:42:13,829::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-434::DEBUG::2013-12-12 10:42:13,829::task::974::TaskManager.Task::(_decref) Task=`3a649e3c-d297-4616-8964-99b72005ab75`::ref 0 aborting False >Thread-437::DEBUG::2013-12-12 10:42:17,420::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-437::DEBUG::2013-12-12 10:42:17,772::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-438::DEBUG::2013-12-12 10:42:17,780::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-438::DEBUG::2013-12-12 10:42:18,056::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-441::DEBUG::2013-12-12 10:42:23,078::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-441::DEBUG::2013-12-12 10:42:23,633::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-442::DEBUG::2013-12-12 10:42:23,642::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-442::DEBUG::2013-12-12 10:42:23,919::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-444::DEBUG::2013-12-12 10:42:28,924::task::579::TaskManager.Task::(_updateState) Task=`4031de6e-bb9c-42d6-8333-cc785ae0ed3e`::moving from state init -> state preparing >Thread-444::INFO::2013-12-12 10:42:28,924::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-444::INFO::2013-12-12 10:42:28,924::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-444::DEBUG::2013-12-12 10:42:28,925::task::1168::TaskManager.Task::(prepare) Task=`4031de6e-bb9c-42d6-8333-cc785ae0ed3e`::finished: {} >Thread-444::DEBUG::2013-12-12 10:42:28,925::task::579::TaskManager.Task::(_updateState) Task=`4031de6e-bb9c-42d6-8333-cc785ae0ed3e`::moving from state preparing -> state finished >Thread-444::DEBUG::2013-12-12 10:42:28,925::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-444::DEBUG::2013-12-12 10:42:28,925::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-444::DEBUG::2013-12-12 10:42:28,925::task::974::TaskManager.Task::(_decref) Task=`4031de6e-bb9c-42d6-8333-cc785ae0ed3e`::ref 0 aborting False >Thread-445::DEBUG::2013-12-12 10:42:28,938::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-445::DEBUG::2013-12-12 10:42:29,447::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-447::DEBUG::2013-12-12 10:42:29,454::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-447::DEBUG::2013-12-12 10:42:29,621::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-451::DEBUG::2013-12-12 10:42:40,255::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-451::DEBUG::2013-12-12 10:42:40,709::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-453::DEBUG::2013-12-12 10:42:44,040::task::579::TaskManager.Task::(_updateState) Task=`02621882-c12a-403d-93f1-38191e317d1a`::moving from state init -> state preparing >Thread-453::INFO::2013-12-12 10:42:44,040::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-453::INFO::2013-12-12 10:42:44,040::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-453::DEBUG::2013-12-12 10:42:44,040::task::1168::TaskManager.Task::(prepare) Task=`02621882-c12a-403d-93f1-38191e317d1a`::finished: {} >Thread-453::DEBUG::2013-12-12 10:42:44,040::task::579::TaskManager.Task::(_updateState) Task=`02621882-c12a-403d-93f1-38191e317d1a`::moving from state preparing -> state finished >Thread-453::DEBUG::2013-12-12 10:42:44,041::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-453::DEBUG::2013-12-12 10:42:44,041::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-453::DEBUG::2013-12-12 10:42:44,041::task::974::TaskManager.Task::(_decref) Task=`02621882-c12a-403d-93f1-38191e317d1a`::ref 0 aborting False >Thread-455::DEBUG::2013-12-12 10:42:46,170::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-455::DEBUG::2013-12-12 10:42:46,685::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-456::DEBUG::2013-12-12 10:42:46,692::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-456::DEBUG::2013-12-12 10:42:46,862::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-459::DEBUG::2013-12-12 10:42:51,881::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-459::DEBUG::2013-12-12 10:42:52,390::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-460::DEBUG::2013-12-12 10:42:52,398::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-460::DEBUG::2013-12-12 10:42:52,713::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-463::DEBUG::2013-12-12 10:42:59,136::task::579::TaskManager.Task::(_updateState) Task=`2ca482ab-41b1-48c5-8c57-37a6925384ac`::moving from state init -> state preparing >Thread-463::INFO::2013-12-12 10:42:59,136::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-463::INFO::2013-12-12 10:42:59,136::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-463::DEBUG::2013-12-12 10:42:59,136::task::1168::TaskManager.Task::(prepare) Task=`2ca482ab-41b1-48c5-8c57-37a6925384ac`::finished: {} >Thread-463::DEBUG::2013-12-12 10:42:59,137::task::579::TaskManager.Task::(_updateState) Task=`2ca482ab-41b1-48c5-8c57-37a6925384ac`::moving from state preparing -> state finished >Thread-463::DEBUG::2013-12-12 10:42:59,137::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-463::DEBUG::2013-12-12 10:42:59,137::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-463::DEBUG::2013-12-12 10:42:59,137::task::974::TaskManager.Task::(_decref) Task=`2ca482ab-41b1-48c5-8c57-37a6925384ac`::ref 0 aborting False >Thread-466::DEBUG::2013-12-12 10:43:03,329::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-466::DEBUG::2013-12-12 10:43:03,769::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-467::DEBUG::2013-12-12 10:43:03,776::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-467::DEBUG::2013-12-12 10:43:04,094::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-470::DEBUG::2013-12-12 10:43:09,121::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-470::DEBUG::2013-12-12 10:43:09,669::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-471::DEBUG::2013-12-12 10:43:09,677::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-471::DEBUG::2013-12-12 10:43:09,856::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-473::DEBUG::2013-12-12 10:43:14,231::task::579::TaskManager.Task::(_updateState) Task=`28d3d38a-a0b1-4b9d-8d98-737d7aa3509c`::moving from state init -> state preparing >Thread-473::INFO::2013-12-12 10:43:14,231::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-473::INFO::2013-12-12 10:43:14,231::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-473::DEBUG::2013-12-12 10:43:14,231::task::1168::TaskManager.Task::(prepare) Task=`28d3d38a-a0b1-4b9d-8d98-737d7aa3509c`::finished: {} >Thread-473::DEBUG::2013-12-12 10:43:14,231::task::579::TaskManager.Task::(_updateState) Task=`28d3d38a-a0b1-4b9d-8d98-737d7aa3509c`::moving from state preparing -> state finished >Thread-473::DEBUG::2013-12-12 10:43:14,232::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-473::DEBUG::2013-12-12 10:43:14,232::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-473::DEBUG::2013-12-12 10:43:14,232::task::974::TaskManager.Task::(_decref) Task=`28d3d38a-a0b1-4b9d-8d98-737d7aa3509c`::ref 0 aborting False >Thread-475::DEBUG::2013-12-12 10:43:14,886::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-475::DEBUG::2013-12-12 10:43:15,273::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-476::DEBUG::2013-12-12 10:43:15,280::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-476::DEBUG::2013-12-12 10:43:15,461::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-481::DEBUG::2013-12-12 10:43:29,349::task::579::TaskManager.Task::(_updateState) Task=`b63b81b2-90c8-4ee9-8bf0-7b59bea0f7f1`::moving from state init -> state preparing >Thread-481::INFO::2013-12-12 10:43:29,349::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-481::INFO::2013-12-12 10:43:29,350::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-481::DEBUG::2013-12-12 10:43:29,350::task::1168::TaskManager.Task::(prepare) Task=`b63b81b2-90c8-4ee9-8bf0-7b59bea0f7f1`::finished: {} >Thread-481::DEBUG::2013-12-12 10:43:29,350::task::579::TaskManager.Task::(_updateState) Task=`b63b81b2-90c8-4ee9-8bf0-7b59bea0f7f1`::moving from state preparing -> state finished >Thread-481::DEBUG::2013-12-12 10:43:29,350::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-481::DEBUG::2013-12-12 10:43:29,350::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-481::DEBUG::2013-12-12 10:43:29,350::task::974::TaskManager.Task::(_decref) Task=`b63b81b2-90c8-4ee9-8bf0-7b59bea0f7f1`::ref 0 aborting False >Thread-486::DEBUG::2013-12-12 10:43:40,720::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-486::DEBUG::2013-12-12 10:43:40,894::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-488::DEBUG::2013-12-12 10:43:43,541::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-488::DEBUG::2013-12-12 10:43:44,018::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-489::DEBUG::2013-12-12 10:43:44,027::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-489::DEBUG::2013-12-12 10:43:44,204::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-490::DEBUG::2013-12-12 10:43:44,441::task::579::TaskManager.Task::(_updateState) Task=`af8cdd29-c930-4ea3-a019-a979874fe983`::moving from state init -> state preparing >Thread-490::INFO::2013-12-12 10:43:44,441::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-490::INFO::2013-12-12 10:43:44,441::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-490::DEBUG::2013-12-12 10:43:44,441::task::1168::TaskManager.Task::(prepare) Task=`af8cdd29-c930-4ea3-a019-a979874fe983`::finished: {} >Thread-490::DEBUG::2013-12-12 10:43:44,442::task::579::TaskManager.Task::(_updateState) Task=`af8cdd29-c930-4ea3-a019-a979874fe983`::moving from state preparing -> state finished >Thread-490::DEBUG::2013-12-12 10:43:44,442::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-490::DEBUG::2013-12-12 10:43:44,442::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-490::DEBUG::2013-12-12 10:43:44,442::task::974::TaskManager.Task::(_decref) Task=`af8cdd29-c930-4ea3-a019-a979874fe983`::ref 0 aborting False >Thread-493::DEBUG::2013-12-12 10:43:49,227::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-493::DEBUG::2013-12-12 10:43:49,780::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-494::DEBUG::2013-12-12 10:43:49,787::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-494::DEBUG::2013-12-12 10:43:50,071::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-497::DEBUG::2013-12-12 10:43:55,092::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-497::DEBUG::2013-12-12 10:43:55,651::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-498::DEBUG::2013-12-12 10:43:55,661::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-498::DEBUG::2013-12-12 10:43:55,829::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-500::DEBUG::2013-12-12 10:43:59,536::task::579::TaskManager.Task::(_updateState) Task=`88aaa5fa-392e-4d67-879f-4aa04dcb527b`::moving from state init -> state preparing >Thread-500::INFO::2013-12-12 10:43:59,536::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-500::INFO::2013-12-12 10:43:59,536::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-500::DEBUG::2013-12-12 10:43:59,537::task::1168::TaskManager.Task::(prepare) Task=`88aaa5fa-392e-4d67-879f-4aa04dcb527b`::finished: {} >Thread-500::DEBUG::2013-12-12 10:43:59,537::task::579::TaskManager.Task::(_updateState) Task=`88aaa5fa-392e-4d67-879f-4aa04dcb527b`::moving from state preparing -> state finished >Thread-500::DEBUG::2013-12-12 10:43:59,537::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-500::DEBUG::2013-12-12 10:43:59,537::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-500::DEBUG::2013-12-12 10:43:59,537::task::974::TaskManager.Task::(_decref) Task=`88aaa5fa-392e-4d67-879f-4aa04dcb527b`::ref 0 aborting False >Thread-506::DEBUG::2013-12-12 10:44:14,639::task::579::TaskManager.Task::(_updateState) Task=`4c64d19f-2fb4-4c4c-8d38-2e559c8e7cdf`::moving from state init -> state preparing >Thread-506::INFO::2013-12-12 10:44:14,639::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-506::INFO::2013-12-12 10:44:14,640::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-506::DEBUG::2013-12-12 10:44:14,640::task::1168::TaskManager.Task::(prepare) Task=`4c64d19f-2fb4-4c4c-8d38-2e559c8e7cdf`::finished: {} >Thread-506::DEBUG::2013-12-12 10:44:14,640::task::579::TaskManager.Task::(_updateState) Task=`4c64d19f-2fb4-4c4c-8d38-2e559c8e7cdf`::moving from state preparing -> state finished >Thread-506::DEBUG::2013-12-12 10:44:14,640::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-506::DEBUG::2013-12-12 10:44:14,640::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-506::DEBUG::2013-12-12 10:44:14,640::task::974::TaskManager.Task::(_decref) Task=`4c64d19f-2fb4-4c4c-8d38-2e559c8e7cdf`::ref 0 aborting False >Thread-509::DEBUG::2013-12-12 10:44:17,857::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-509::DEBUG::2013-12-12 10:44:18,212::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-510::DEBUG::2013-12-12 10:44:18,220::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-510::DEBUG::2013-12-12 10:44:18,417::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-512::DEBUG::2013-12-12 10:44:23,511::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-512::DEBUG::2013-12-12 10:44:23,849::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-514::DEBUG::2013-12-12 10:44:23,856::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-514::DEBUG::2013-12-12 10:44:24,066::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-516::DEBUG::2013-12-12 10:44:29,729::task::579::TaskManager.Task::(_updateState) Task=`08f0358d-88b9-4c57-97bc-cc1e58412705`::moving from state init -> state preparing >Thread-516::INFO::2013-12-12 10:44:29,729::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-516::INFO::2013-12-12 10:44:29,729::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-516::DEBUG::2013-12-12 10:44:29,730::task::1168::TaskManager.Task::(prepare) Task=`08f0358d-88b9-4c57-97bc-cc1e58412705`::finished: {} >Thread-516::DEBUG::2013-12-12 10:44:29,730::task::579::TaskManager.Task::(_updateState) Task=`08f0358d-88b9-4c57-97bc-cc1e58412705`::moving from state preparing -> state finished >Thread-516::DEBUG::2013-12-12 10:44:29,730::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-516::DEBUG::2013-12-12 10:44:29,730::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-516::DEBUG::2013-12-12 10:44:29,730::task::974::TaskManager.Task::(_decref) Task=`08f0358d-88b9-4c57-97bc-cc1e58412705`::ref 0 aborting False >Thread-519::DEBUG::2013-12-12 10:44:34,858::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-519::DEBUG::2013-12-12 10:44:35,242::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-520::DEBUG::2013-12-12 10:44:35,249::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-520::DEBUG::2013-12-12 10:44:35,415::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-524::DEBUG::2013-12-12 10:44:44,834::task::579::TaskManager.Task::(_updateState) Task=`73ca81b7-c2bc-4171-ab2b-dde7107aa1b5`::moving from state init -> state preparing >Thread-524::INFO::2013-12-12 10:44:44,834::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-524::INFO::2013-12-12 10:44:44,834::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-524::DEBUG::2013-12-12 10:44:44,835::task::1168::TaskManager.Task::(prepare) Task=`73ca81b7-c2bc-4171-ab2b-dde7107aa1b5`::finished: {} >Thread-524::DEBUG::2013-12-12 10:44:44,835::task::579::TaskManager.Task::(_updateState) Task=`73ca81b7-c2bc-4171-ab2b-dde7107aa1b5`::moving from state preparing -> state finished >Thread-524::DEBUG::2013-12-12 10:44:44,835::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-524::DEBUG::2013-12-12 10:44:44,835::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-524::DEBUG::2013-12-12 10:44:44,835::task::974::TaskManager.Task::(_decref) Task=`73ca81b7-c2bc-4171-ab2b-dde7107aa1b5`::ref 0 aborting False >Thread-526::DEBUG::2013-12-12 10:44:46,725::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-526::DEBUG::2013-12-12 10:44:47,268::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-527::DEBUG::2013-12-12 10:44:47,276::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-527::DEBUG::2013-12-12 10:44:47,680::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-530::DEBUG::2013-12-12 10:44:52,768::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-530::DEBUG::2013-12-12 10:44:53,133::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-531::DEBUG::2013-12-12 10:44:53,140::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-531::DEBUG::2013-12-12 10:44:53,359::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-534::DEBUG::2013-12-12 10:44:59,967::task::579::TaskManager.Task::(_updateState) Task=`ac03a360-ccf0-466f-84c2-c102157cf740`::moving from state init -> state preparing >Thread-534::INFO::2013-12-12 10:44:59,968::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-534::INFO::2013-12-12 10:44:59,968::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-534::DEBUG::2013-12-12 10:44:59,968::task::1168::TaskManager.Task::(prepare) Task=`ac03a360-ccf0-466f-84c2-c102157cf740`::finished: {} >Thread-534::DEBUG::2013-12-12 10:44:59,968::task::579::TaskManager.Task::(_updateState) Task=`ac03a360-ccf0-466f-84c2-c102157cf740`::moving from state preparing -> state finished >Thread-534::DEBUG::2013-12-12 10:44:59,968::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-534::DEBUG::2013-12-12 10:44:59,969::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-534::DEBUG::2013-12-12 10:44:59,969::task::974::TaskManager.Task::(_decref) Task=`ac03a360-ccf0-466f-84c2-c102157cf740`::ref 0 aborting False >Thread-537::DEBUG::2013-12-12 10:45:03,977::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-537::DEBUG::2013-12-12 10:45:04,447::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-538::DEBUG::2013-12-12 10:45:04,454::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-538::DEBUG::2013-12-12 10:45:04,684::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-541::DEBUG::2013-12-12 10:45:09,769::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-541::DEBUG::2013-12-12 10:45:10,141::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-542::DEBUG::2013-12-12 10:45:10,165::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-542::DEBUG::2013-12-12 10:45:10,362::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-544::DEBUG::2013-12-12 10:45:15,084::task::579::TaskManager.Task::(_updateState) Task=`0513f832-3d94-4d9c-8225-06f7985f6763`::moving from state init -> state preparing >Thread-544::INFO::2013-12-12 10:45:15,084::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-544::INFO::2013-12-12 10:45:15,085::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-544::DEBUG::2013-12-12 10:45:15,085::task::1168::TaskManager.Task::(prepare) Task=`0513f832-3d94-4d9c-8225-06f7985f6763`::finished: {} >Thread-544::DEBUG::2013-12-12 10:45:15,085::task::579::TaskManager.Task::(_updateState) Task=`0513f832-3d94-4d9c-8225-06f7985f6763`::moving from state preparing -> state finished >Thread-544::DEBUG::2013-12-12 10:45:15,085::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-544::DEBUG::2013-12-12 10:45:15,085::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-544::DEBUG::2013-12-12 10:45:15,085::task::974::TaskManager.Task::(_decref) Task=`0513f832-3d94-4d9c-8225-06f7985f6763`::ref 0 aborting False >Thread-548::DEBUG::2013-12-12 10:45:21,360::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-548::DEBUG::2013-12-12 10:45:22,007::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-549::DEBUG::2013-12-12 10:45:22,015::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-549::DEBUG::2013-12-12 10:45:22,224::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-552::DEBUG::2013-12-12 10:45:27,385::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-552::DEBUG::2013-12-12 10:45:27,873::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-553::DEBUG::2013-12-12 10:45:27,881::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-553::DEBUG::2013-12-12 10:45:28,050::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-554::DEBUG::2013-12-12 10:45:30,178::task::579::TaskManager.Task::(_updateState) Task=`7c66b3a0-0c85-4d1c-992d-407a7ad819fb`::moving from state init -> state preparing >Thread-554::INFO::2013-12-12 10:45:30,178::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-554::INFO::2013-12-12 10:45:30,178::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-554::DEBUG::2013-12-12 10:45:30,178::task::1168::TaskManager.Task::(prepare) Task=`7c66b3a0-0c85-4d1c-992d-407a7ad819fb`::finished: {} >Thread-554::DEBUG::2013-12-12 10:45:30,179::task::579::TaskManager.Task::(_updateState) Task=`7c66b3a0-0c85-4d1c-992d-407a7ad819fb`::moving from state preparing -> state finished >Thread-554::DEBUG::2013-12-12 10:45:30,179::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-554::DEBUG::2013-12-12 10:45:30,179::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-554::DEBUG::2013-12-12 10:45:30,179::task::974::TaskManager.Task::(_decref) Task=`7c66b3a0-0c85-4d1c-992d-407a7ad819fb`::ref 0 aborting False >Thread-556::DEBUG::2013-12-12 10:45:33,075::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-556::DEBUG::2013-12-12 10:45:33,627::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-558::DEBUG::2013-12-12 10:45:33,635::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-558::DEBUG::2013-12-12 10:45:33,882::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-562::DEBUG::2013-12-12 10:45:45,363::task::579::TaskManager.Task::(_updateState) Task=`f252ba0f-abda-4db7-bbfb-06b6b97db14a`::moving from state init -> state preparing >Thread-562::INFO::2013-12-12 10:45:45,363::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-562::INFO::2013-12-12 10:45:45,363::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-562::DEBUG::2013-12-12 10:45:45,363::task::1168::TaskManager.Task::(prepare) Task=`f252ba0f-abda-4db7-bbfb-06b6b97db14a`::finished: {} >Thread-562::DEBUG::2013-12-12 10:45:45,363::task::579::TaskManager.Task::(_updateState) Task=`f252ba0f-abda-4db7-bbfb-06b6b97db14a`::moving from state preparing -> state finished >Thread-562::DEBUG::2013-12-12 10:45:45,363::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-562::DEBUG::2013-12-12 10:45:45,364::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-562::DEBUG::2013-12-12 10:45:45,364::task::974::TaskManager.Task::(_decref) Task=`f252ba0f-abda-4db7-bbfb-06b6b97db14a`::ref 0 aborting False >Thread-568::DEBUG::2013-12-12 10:46:00,462::task::579::TaskManager.Task::(_updateState) Task=`d5c459b6-aa72-4095-8e6d-d4043235c85e`::moving from state init -> state preparing >Thread-568::INFO::2013-12-12 10:46:00,462::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-568::INFO::2013-12-12 10:46:00,462::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-568::DEBUG::2013-12-12 10:46:00,462::task::1168::TaskManager.Task::(prepare) Task=`d5c459b6-aa72-4095-8e6d-d4043235c85e`::finished: {} >Thread-568::DEBUG::2013-12-12 10:46:00,462::task::579::TaskManager.Task::(_updateState) Task=`d5c459b6-aa72-4095-8e6d-d4043235c85e`::moving from state preparing -> state finished >Thread-568::DEBUG::2013-12-12 10:46:00,462::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-568::DEBUG::2013-12-12 10:46:00,463::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-568::DEBUG::2013-12-12 10:46:00,463::task::974::TaskManager.Task::(_decref) Task=`d5c459b6-aa72-4095-8e6d-d4043235c85e`::ref 0 aborting False >Thread-573::DEBUG::2013-12-12 10:46:10,745::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-573::DEBUG::2013-12-12 10:46:11,237::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-574::DEBUG::2013-12-12 10:46:11,244::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-574::DEBUG::2013-12-12 10:46:11,416::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-576::DEBUG::2013-12-12 10:46:15,561::task::579::TaskManager.Task::(_updateState) Task=`32da639c-4136-4415-8363-fe586e2a6b71`::moving from state init -> state preparing >Thread-576::INFO::2013-12-12 10:46:15,561::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-576::INFO::2013-12-12 10:46:15,561::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-576::DEBUG::2013-12-12 10:46:15,562::task::1168::TaskManager.Task::(prepare) Task=`32da639c-4136-4415-8363-fe586e2a6b71`::finished: {} >Thread-576::DEBUG::2013-12-12 10:46:15,562::task::579::TaskManager.Task::(_updateState) Task=`32da639c-4136-4415-8363-fe586e2a6b71`::moving from state preparing -> state finished >Thread-576::DEBUG::2013-12-12 10:46:15,562::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-576::DEBUG::2013-12-12 10:46:15,562::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-576::DEBUG::2013-12-12 10:46:15,562::task::974::TaskManager.Task::(_decref) Task=`32da639c-4136-4415-8363-fe586e2a6b71`::ref 0 aborting False >Thread-580::DEBUG::2013-12-12 10:46:22,545::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-580::DEBUG::2013-12-12 10:46:23,003::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-581::DEBUG::2013-12-12 10:46:23,011::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-581::DEBUG::2013-12-12 10:46:23,181::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-584::DEBUG::2013-12-12 10:46:30,691::task::579::TaskManager.Task::(_updateState) Task=`963c153a-3c6b-465f-8c27-f972883e4b24`::moving from state init -> state preparing >Thread-584::INFO::2013-12-12 10:46:30,691::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-584::INFO::2013-12-12 10:46:30,691::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-584::DEBUG::2013-12-12 10:46:30,691::task::1168::TaskManager.Task::(prepare) Task=`963c153a-3c6b-465f-8c27-f972883e4b24`::finished: {} >Thread-584::DEBUG::2013-12-12 10:46:30,692::task::579::TaskManager.Task::(_updateState) Task=`963c153a-3c6b-465f-8c27-f972883e4b24`::moving from state preparing -> state finished >Thread-584::DEBUG::2013-12-12 10:46:30,692::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-584::DEBUG::2013-12-12 10:46:30,692::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-584::DEBUG::2013-12-12 10:46:30,692::task::974::TaskManager.Task::(_decref) Task=`963c153a-3c6b-465f-8c27-f972883e4b24`::ref 0 aborting False >Thread-588::DEBUG::2013-12-12 10:46:39,422::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-588::DEBUG::2013-12-12 10:46:39,756::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-589::DEBUG::2013-12-12 10:46:39,763::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-589::DEBUG::2013-12-12 10:46:39,944::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-592::DEBUG::2013-12-12 10:46:44,966::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-592::DEBUG::2013-12-12 10:46:45,356::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-593::DEBUG::2013-12-12 10:46:45,363::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-593::DEBUG::2013-12-12 10:46:45,536::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-594::DEBUG::2013-12-12 10:46:45,844::task::579::TaskManager.Task::(_updateState) Task=`7986b95d-ebce-4dfd-b8ac-a579d79fe766`::moving from state init -> state preparing >Thread-594::INFO::2013-12-12 10:46:45,844::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-594::INFO::2013-12-12 10:46:45,845::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-594::DEBUG::2013-12-12 10:46:45,845::task::1168::TaskManager.Task::(prepare) Task=`7986b95d-ebce-4dfd-b8ac-a579d79fe766`::finished: {} >Thread-594::DEBUG::2013-12-12 10:46:45,846::task::579::TaskManager.Task::(_updateState) Task=`7986b95d-ebce-4dfd-b8ac-a579d79fe766`::moving from state preparing -> state finished >Thread-594::DEBUG::2013-12-12 10:46:45,846::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-594::DEBUG::2013-12-12 10:46:45,847::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-594::DEBUG::2013-12-12 10:46:45,847::task::974::TaskManager.Task::(_decref) Task=`7986b95d-ebce-4dfd-b8ac-a579d79fe766`::ref 0 aborting False >Thread-597::DEBUG::2013-12-12 10:46:51,879::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-597::ERROR::2013-12-12 10:46:52,057::BindingXMLRPC::1000::vds::(wrapper) vdsm exception occured >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 989, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 53, in wrapper > rv = func(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 295, in tasksList > status = self.svdsmProxy.glusterTasksList(taskIds) > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in glusterTasksList > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >GlusterCmdExecFailedException: Command execution failed >return code: 2 >Thread-601::DEBUG::2013-12-12 10:46:59,010::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-601::DEBUG::2013-12-12 10:46:59,721::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-602::DEBUG::2013-12-12 10:46:59,734::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-602::DEBUG::2013-12-12 10:47:00,027::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-603::DEBUG::2013-12-12 10:47:00,947::task::579::TaskManager.Task::(_updateState) Task=`1ee8bf55-df23-4a32-aea8-6586e5bd4a62`::moving from state init -> state preparing >Thread-603::INFO::2013-12-12 10:47:00,947::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-603::INFO::2013-12-12 10:47:00,948::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-603::DEBUG::2013-12-12 10:47:00,948::task::1168::TaskManager.Task::(prepare) Task=`1ee8bf55-df23-4a32-aea8-6586e5bd4a62`::finished: {} >Thread-603::DEBUG::2013-12-12 10:47:00,948::task::579::TaskManager.Task::(_updateState) Task=`1ee8bf55-df23-4a32-aea8-6586e5bd4a62`::moving from state preparing -> state finished >Thread-603::DEBUG::2013-12-12 10:47:00,948::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-603::DEBUG::2013-12-12 10:47:00,948::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-603::DEBUG::2013-12-12 10:47:00,948::task::974::TaskManager.Task::(_decref) Task=`1ee8bf55-df23-4a32-aea8-6586e5bd4a62`::ref 0 aborting False >Thread-606::DEBUG::2013-12-12 10:47:05,049::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-606::DEBUG::2013-12-12 10:47:05,387::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-607::DEBUG::2013-12-12 10:47:05,396::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-607::DEBUG::2013-12-12 10:47:05,565::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-609::DEBUG::2013-12-12 10:47:07,979::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeStart with ('blah', False) {} flowID [dfa0ec1] >Thread-609::ERROR::2013-12-12 10:47:08,295::BindingXMLRPC::1000::vds::(wrapper) vdsm exception occured >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 989, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 53, in wrapper > rv = func(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 89, in volumeStart > self.svdsmProxy.glusterVolumeStart(volumeName, force) > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in glusterVolumeStart > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >GlusterVolumeStartFailedException: Volume start failed >error: volume start: blah: failed: Commit failed on localhost. Please check the log file for more details. >return code: 1 >Thread-611::DEBUG::2013-12-12 10:47:10,587::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-611::DEBUG::2013-12-12 10:47:11,003::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-612::DEBUG::2013-12-12 10:47:11,010::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-612::DEBUG::2013-12-12 10:47:11,185::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-614::DEBUG::2013-12-12 10:47:16,062::task::579::TaskManager.Task::(_updateState) Task=`11043cfe-bb44-4afa-ac81-694e9a032bc9`::moving from state init -> state preparing >Thread-614::INFO::2013-12-12 10:47:16,062::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-614::INFO::2013-12-12 10:47:16,063::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-614::DEBUG::2013-12-12 10:47:16,063::task::1168::TaskManager.Task::(prepare) Task=`11043cfe-bb44-4afa-ac81-694e9a032bc9`::finished: {} >Thread-614::DEBUG::2013-12-12 10:47:16,063::task::579::TaskManager.Task::(_updateState) Task=`11043cfe-bb44-4afa-ac81-694e9a032bc9`::moving from state preparing -> state finished >Thread-614::DEBUG::2013-12-12 10:47:16,063::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-614::DEBUG::2013-12-12 10:47:16,063::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-614::DEBUG::2013-12-12 10:47:16,063::task::974::TaskManager.Task::(_decref) Task=`11043cfe-bb44-4afa-ac81-694e9a032bc9`::ref 0 aborting False >Thread-616::DEBUG::2013-12-12 10:47:16,207::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-616::DEBUG::2013-12-12 10:47:16,611::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-617::DEBUG::2013-12-12 10:47:16,619::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-617::DEBUG::2013-12-12 10:47:16,971::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-621::DEBUG::2013-12-12 10:47:27,942::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} flowID [4be577d1] >Thread-621::DEBUG::2013-12-12 10:47:28,577::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-623::DEBUG::2013-12-12 10:47:28,584::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} flowID [4be577d1] >Thread-623::DEBUG::2013-12-12 10:47:28,755::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-624::DEBUG::2013-12-12 10:47:31,180::task::579::TaskManager.Task::(_updateState) Task=`7838e977-dd15-4d95-b9ca-49b1fdbe085c`::moving from state init -> state preparing >Thread-624::INFO::2013-12-12 10:47:31,180::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-624::INFO::2013-12-12 10:47:31,181::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-624::DEBUG::2013-12-12 10:47:31,181::task::1168::TaskManager.Task::(prepare) Task=`7838e977-dd15-4d95-b9ca-49b1fdbe085c`::finished: {} >Thread-624::DEBUG::2013-12-12 10:47:31,181::task::579::TaskManager.Task::(_updateState) Task=`7838e977-dd15-4d95-b9ca-49b1fdbe085c`::moving from state preparing -> state finished >Thread-624::DEBUG::2013-12-12 10:47:31,181::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-624::DEBUG::2013-12-12 10:47:31,181::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-624::DEBUG::2013-12-12 10:47:31,181::task::974::TaskManager.Task::(_decref) Task=`7838e977-dd15-4d95-b9ca-49b1fdbe085c`::ref 0 aborting False >Thread-626::DEBUG::2013-12-12 10:47:33,775::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-626::DEBUG::2013-12-12 10:47:34,113::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-627::DEBUG::2013-12-12 10:47:34,120::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-627::DEBUG::2013-12-12 10:47:34,292::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-632::DEBUG::2013-12-12 10:47:45,131::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-632::DEBUG::2013-12-12 10:47:45,520::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-633::DEBUG::2013-12-12 10:47:45,528::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-633::DEBUG::2013-12-12 10:47:45,698::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-634::DEBUG::2013-12-12 10:47:46,314::task::579::TaskManager.Task::(_updateState) Task=`0187f0eb-a43c-4433-bf77-71e55b7af4f3`::moving from state init -> state preparing >Thread-634::INFO::2013-12-12 10:47:46,314::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-634::INFO::2013-12-12 10:47:46,315::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-634::DEBUG::2013-12-12 10:47:46,315::task::1168::TaskManager.Task::(prepare) Task=`0187f0eb-a43c-4433-bf77-71e55b7af4f3`::finished: {} >Thread-634::DEBUG::2013-12-12 10:47:46,315::task::579::TaskManager.Task::(_updateState) Task=`0187f0eb-a43c-4433-bf77-71e55b7af4f3`::moving from state preparing -> state finished >Thread-634::DEBUG::2013-12-12 10:47:46,315::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-634::DEBUG::2013-12-12 10:47:46,315::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-634::DEBUG::2013-12-12 10:47:46,315::task::974::TaskManager.Task::(_decref) Task=`0187f0eb-a43c-4433-bf77-71e55b7af4f3`::ref 0 aborting False >Thread-639::DEBUG::2013-12-12 10:47:56,282::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-639::DEBUG::2013-12-12 10:47:57,051::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-640::DEBUG::2013-12-12 10:47:57,059::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-640::DEBUG::2013-12-12 10:47:57,229::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-642::DEBUG::2013-12-12 10:48:01,491::task::579::TaskManager.Task::(_updateState) Task=`2b202249-61c1-446d-a814-d259804d4eef`::moving from state init -> state preparing >Thread-642::INFO::2013-12-12 10:48:01,491::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-642::INFO::2013-12-12 10:48:01,491::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-642::DEBUG::2013-12-12 10:48:01,491::task::1168::TaskManager.Task::(prepare) Task=`2b202249-61c1-446d-a814-d259804d4eef`::finished: {} >Thread-642::DEBUG::2013-12-12 10:48:01,491::task::579::TaskManager.Task::(_updateState) Task=`2b202249-61c1-446d-a814-d259804d4eef`::moving from state preparing -> state finished >Thread-642::DEBUG::2013-12-12 10:48:01,492::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-642::DEBUG::2013-12-12 10:48:01,492::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-642::DEBUG::2013-12-12 10:48:01,492::task::974::TaskManager.Task::(_decref) Task=`2b202249-61c1-446d-a814-d259804d4eef`::ref 0 aborting False >Thread-648::DEBUG::2013-12-12 10:48:16,706::task::579::TaskManager.Task::(_updateState) Task=`6c54145c-49ef-48c4-a451-1f813a77affd`::moving from state init -> state preparing >Thread-648::INFO::2013-12-12 10:48:16,706::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-648::INFO::2013-12-12 10:48:16,706::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-648::DEBUG::2013-12-12 10:48:16,706::task::1168::TaskManager.Task::(prepare) Task=`6c54145c-49ef-48c4-a451-1f813a77affd`::finished: {} >Thread-648::DEBUG::2013-12-12 10:48:16,706::task::579::TaskManager.Task::(_updateState) Task=`6c54145c-49ef-48c4-a451-1f813a77affd`::moving from state preparing -> state finished >Thread-648::DEBUG::2013-12-12 10:48:16,706::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-648::DEBUG::2013-12-12 10:48:16,707::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-648::DEBUG::2013-12-12 10:48:16,707::task::974::TaskManager.Task::(_decref) Task=`6c54145c-49ef-48c4-a451-1f813a77affd`::ref 0 aborting False >Thread-652::DEBUG::2013-12-12 10:48:25,454::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-652::DEBUG::2013-12-12 10:48:25,933::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-654::DEBUG::2013-12-12 10:48:25,941::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-654::DEBUG::2013-12-12 10:48:26,128::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-656::DEBUG::2013-12-12 10:48:31,146::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-656::DEBUG::2013-12-12 10:48:31,695::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-657::DEBUG::2013-12-12 10:48:31,705::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-657::DEBUG::2013-12-12 10:48:31,865::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-658::DEBUG::2013-12-12 10:48:31,879::task::579::TaskManager.Task::(_updateState) Task=`049839fc-745a-4c4d-871f-e71637a17dbc`::moving from state init -> state preparing >Thread-658::INFO::2013-12-12 10:48:31,880::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-658::INFO::2013-12-12 10:48:31,880::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-658::DEBUG::2013-12-12 10:48:31,880::task::1168::TaskManager.Task::(prepare) Task=`049839fc-745a-4c4d-871f-e71637a17dbc`::finished: {} >Thread-658::DEBUG::2013-12-12 10:48:31,880::task::579::TaskManager.Task::(_updateState) Task=`049839fc-745a-4c4d-871f-e71637a17dbc`::moving from state preparing -> state finished >Thread-658::DEBUG::2013-12-12 10:48:31,880::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-658::DEBUG::2013-12-12 10:48:31,880::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-658::DEBUG::2013-12-12 10:48:31,881::task::974::TaskManager.Task::(_decref) Task=`049839fc-745a-4c4d-871f-e71637a17dbc`::ref 0 aborting False >MainThread::DEBUG::2013-12-12 12:51:41,965::vdsm::45::vds::(sigtermHandler) Received signal 15 >MainThread::INFO::2013-12-12 12:51:42,718::vmChannels::183::vds::(stop) VM channels listener was stopped. >MainThread::DEBUG::2013-12-12 12:51:42,719::task::579::TaskManager.Task::(_updateState) Task=`1ee62014-bf92-4279-8d96-be8c625f4e4c`::moving from state init -> state preparing >MainThread::INFO::2013-12-12 12:51:42,719::logUtils::44::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2013-12-12 12:51:42,739::storageServer::698::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::INFO::2013-12-12 12:51:43,026::domainMonitor::126::Storage.DomainMonitor::(close) Stopping domain monitors >MainThread::DEBUG::2013-12-12 12:51:43,026::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2013-12-12 12:51:43,027::logUtils::47::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2013-12-12 12:51:43,027::task::1168::TaskManager.Task::(prepare) Task=`1ee62014-bf92-4279-8d96-be8c625f4e4c`::finished: None >MainThread::DEBUG::2013-12-12 12:51:43,027::task::579::TaskManager.Task::(_updateState) Task=`1ee62014-bf92-4279-8d96-be8c625f4e4c`::moving from state preparing -> state finished >MainThread::DEBUG::2013-12-12 12:51:43,027::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-12-12 12:51:43,027::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-12-12 12:51:43,027::task::974::TaskManager.Task::(_decref) Task=`1ee62014-bf92-4279-8d96-be8c625f4e4c`::ref 0 aborting False >MainThread::INFO::2013-12-12 12:51:43,028::vdsm::107::vds::(run) VDSM main thread ended. Waiting for 13 other threads... >MainThread::INFO::2013-12-12 12:51:43,028::vdsm::111::vds::(run) <_MainThread(MainThread, started 140534822790912)> >MainThread::INFO::2013-12-12 12:51:43,028::vdsm::111::vds::(run) <Thread(libvirtEventLoop, started daemon 140534602712832)> >MainThread::INFO::2013-12-12 12:51:43,028::vdsm::111::vds::(run) <WorkerThread(Thread-10, started daemon 140534039426816)> >MainThread::INFO::2013-12-12 12:51:43,028::vdsm::111::vds::(run) <WorkerThread(Thread-7, started daemon 140534070896384)> >MainThread::INFO::2013-12-12 12:51:43,028::vdsm::111::vds::(run) <WorkerThread(Thread-5, started daemon 140534430418688)> >MainThread::INFO::2013-12-12 12:51:43,029::vdsm::111::vds::(run) <WorkerThread(Thread-9, started daemon 140534049916672)> >MainThread::INFO::2013-12-12 12:51:43,029::vdsm::111::vds::(run) <WorkerThread(Thread-4, started daemon 140534440908544)> >MainThread::INFO::2013-12-12 12:51:43,029::vdsm::111::vds::(run) <WorkerThread(Thread-3, started daemon 140534451398400)> >MainThread::INFO::2013-12-12 12:51:43,029::vdsm::111::vds::(run) <WorkerThread(Thread-6, started daemon 140534081386240)> >MainThread::INFO::2013-12-12 12:51:43,029::vdsm::111::vds::(run) <KsmMonitorThread(KsmMonitor, started daemon 140533926188800)> >MainThread::INFO::2013-12-12 12:51:43,029::vdsm::111::vds::(run) <WorkerThread(Thread-1, started daemon 140534472378112)> >MainThread::INFO::2013-12-12 12:51:43,029::vmChannels::183::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2013-12-12 12:51:43,030::vdsm::111::vds::(run) <Listener(VM Channels Listener, started daemon 140533905209088)> >MainThread::INFO::2013-12-12 12:51:43,030::vdsm::111::vds::(run) <WorkerThread(Thread-8, started daemon 140534060406528)> >MainThread::INFO::2013-12-12 12:51:43,030::vdsm::111::vds::(run) <WorkerThread(Thread-2, started daemon 140534461888256)> >MainThread::INFO::2013-12-12 12:52:02,114::vdsm::101::vds::(run) (PID: 17443) I am the actual vdsm 4.13.0-23.1.el6rhs rhs-21u2-20131208-b (2.6.32-358.28.1.el6.x86_64) >MainThread::DEBUG::2013-12-12 12:52:02,378::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2013-12-12 12:52:02,378::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2013-12-12 12:52:02,393::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2013-12-12 12:52:02,979::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::INFO::2013-12-12 12:52:03,180::multipath::134::Storage.Multipath::(isEnabled) Manual override for multipath.conf detected - preserving current configuration >MainThread::WARNING::2013-12-12 12:52:03,180::multipath::137::Storage.Multipath::(isEnabled) This manual override for multipath.conf was based on downrevved template. You are strongly advised to contact your support representatives >MainThread::DEBUG::2013-12-12 12:52:03,180::hsm::426::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2013-12-12 12:52:03,236::hsm::426::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-12-12 12:52:03,237::hsm::450::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2013-12-12 12:52:03,239::hsm::482::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2013-12-12 12:52:03,239::hsm::483::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2013-12-12 12:52:03,239::hsm::485::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2013-12-12 12:52:03,240::hsm::528::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2013-12-12 12:52:03,244::dispatcher::98::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >MainThread::DEBUG::2013-12-12 12:52:03,244::task::579::TaskManager.Task::(_updateState) Task=`00739600-9a17-4d2d-a82f-bbf460c820aa`::moving from state init -> state preparing >MainThread::INFO::2013-12-12 12:52:03,245::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0x7fd601e6d200>>) >MainThread::INFO::2013-12-12 12:52:03,245::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None >MainThread::DEBUG::2013-12-12 12:52:03,245::task::1168::TaskManager.Task::(prepare) Task=`00739600-9a17-4d2d-a82f-bbf460c820aa`::finished: None >MainThread::DEBUG::2013-12-12 12:52:03,245::task::579::TaskManager.Task::(_updateState) Task=`00739600-9a17-4d2d-a82f-bbf460c820aa`::moving from state preparing -> state finished >MainThread::DEBUG::2013-12-12 12:52:03,245::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-12-12 12:52:03,246::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-12-12 12:52:03,246::task::974::TaskManager.Task::(_decref) Task=`00739600-9a17-4d2d-a82f-bbf460c820aa`::ref 0 aborting False >storageRefresh::DEBUG::2013-12-12 12:52:03,250::lvm::338::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 12:52:03,251::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::WARNING::2013-12-12 12:52:03,262::clientIF::196::vds::(_prepareMOM) MOM is not available, fallback to KsmMonitor >MainThread::DEBUG::2013-12-12 12:52:03,263::utils::489::root::(execCmd) '/usr/bin/pgrep -xf ksmd' (cwd None) >MainThread::DEBUG::2013-12-12 12:52:03,307::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2013-12-12 12:52:03,308::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 29 >storageRefresh::DEBUG::2013-12-12 12:52:03,344::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 12:52:03,345::lvm::363::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 12:52:03,345::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 12:52:03,346::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >KsmMonitor::DEBUG::2013-12-12 12:52:03,357::utils::489::root::(execCmd) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2013-12-12 12:52:03,368::vmChannels::187::vds::(settimeout) Setting channels' timeout to 30 seconds. >clientIFinit::DEBUG::2013-12-12 12:52:03,369::libvirtconnection::131::libvirtconnection::(get) trying to connect libvirt >storageRefresh::DEBUG::2013-12-12 12:52:03,413::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 12:52:03,413::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 12:52:03,414::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >VM Channels Listener::INFO::2013-12-12 12:52:03,429::vmChannels::170::vds::(run) Starting VM channels listener thread. >storageRefresh::DEBUG::2013-12-12 12:52:03,482::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 12:52:03,483::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 12:52:03,483::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >storageRefresh::DEBUG::2013-12-12 12:52:03,543::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 12:52:03,544::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 12:52:03,544::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >storageRefresh::DEBUG::2013-12-12 12:52:03,544::misc::811::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-12-12 12:52:03,544::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2013-12-12 12:52:03,545::misc::811::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-12-12 12:52:03,545::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2013-12-12 12:52:03,574::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >storageRefresh::DEBUG::2013-12-12 12:52:03,574::misc::819::SamplingMethod::(__call__) Returning last result >Thread-13::DEBUG::2013-12-12 12:52:04,122::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call ping with () {} flowID [2710cde3] >Thread-13::DEBUG::2013-12-12 12:52:04,122::BindingXMLRPC::991::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-14::DEBUG::2013-12-12 12:52:04,132::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getCapabilities with () {} flowID [2710cde3] >Thread-14::DEBUG::2013-12-12 12:52:04,191::utils::489::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-14::DEBUG::2013-12-12 12:52:04,222::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2013-12-12 12:52:04,247::caps::363::root::(_getKeyPackages) rpm package glusterfs-rdma not found >Thread-14::DEBUG::2013-12-12 12:52:04,247::caps::363::root::(_getKeyPackages) rpm package glusterfs-fuse not found >Thread-14::DEBUG::2013-12-12 12:52:04,248::caps::363::root::(_getKeyPackages) rpm package gluster-swift not found >Thread-14::DEBUG::2013-12-12 12:52:04,248::caps::363::root::(_getKeyPackages) rpm package qemu-kvm-rhev not found >Thread-14::DEBUG::2013-12-12 12:52:04,249::caps::363::root::(_getKeyPackages) rpm package gluster-swift-object not found >Thread-14::DEBUG::2013-12-12 12:52:04,249::caps::363::root::(_getKeyPackages) rpm package glusterfs not found >Thread-14::DEBUG::2013-12-12 12:52:04,249::caps::363::root::(_getKeyPackages) rpm package gluster-swift-plugin not found >Thread-14::DEBUG::2013-12-12 12:52:04,250::caps::363::root::(_getKeyPackages) rpm package qemu-img-rhev not found >Thread-14::DEBUG::2013-12-12 12:52:04,250::caps::363::root::(_getKeyPackages) rpm package ('mom',) not found >Thread-14::DEBUG::2013-12-12 12:52:04,250::caps::363::root::(_getKeyPackages) rpm package gluster-swift-account not found >Thread-14::DEBUG::2013-12-12 12:52:04,251::caps::363::root::(_getKeyPackages) rpm package gluster-swift-proxy not found >Thread-14::DEBUG::2013-12-12 12:52:04,251::caps::363::root::(_getKeyPackages) rpm package gluster-swift-doc not found >Thread-14::DEBUG::2013-12-12 12:52:04,251::caps::363::root::(_getKeyPackages) rpm package glusterfs-server not found >Thread-14::DEBUG::2013-12-12 12:52:04,252::caps::363::root::(_getKeyPackages) rpm package gluster-swift-container not found >Thread-14::DEBUG::2013-12-12 12:52:04,252::caps::363::root::(_getKeyPackages) rpm package glusterfs-geo-replication not found >Thread-14::DEBUG::2013-12-12 12:52:04,255::BindingXMLRPC::991::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.28.1.el6.x86_64', 'buildtime': 1384533955.0, 'version': '2.6.32'}, 'vdsm': {'release': '23.1.el6rhs', 'buildtime': 1386773756L, 'version': '4.13.0'}, 'spice-server': {'release': '12.el6_4.5', 'buildtime': 1381834662L, 'version': '0.12.0'}, 'libvirt': {'release': '18.el6_4.13', 'buildtime': 1379320058L, 'version': '0.10.2'}}, 'cpuModel': 'QEMU Virtual CPU version 1.4.2', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.14.16.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.14.16.254', 'ports': ['eth0']}}, 'uuid': '7B904C94-94EE-7B49-40B3-BD3C28FBB749', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'netmask': '', 'addr': '', 'hwaddr': '52:54:00:b7:60:bc', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': '52:54:00:b7:60:bc', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 100, 'mtu': '1500'}}, 'software_revision': '23.1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': 'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,lm,up,rep_good,unfair_spinlock,pni,cx16,popcnt,hypervisor,lahf_lm', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '4062', 'cpuSpeed': '2393.998', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '1', 'kvmEnabled': 'false', 'rhsVersion': {'release': '1.el6rhs', 'version': '2.1.2.0', 'name': 'RHS'}, 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '1', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.14.16.112'}} >Thread-15::DEBUG::2013-12-12 12:52:04,480::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getCapabilities with () {} >Thread-15::DEBUG::2013-12-12 12:52:04,481::utils::489::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-15::DEBUG::2013-12-12 12:52:04,486::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2013-12-12 12:52:04,498::caps::363::root::(_getKeyPackages) rpm package glusterfs-rdma not found >Thread-15::DEBUG::2013-12-12 12:52:04,498::caps::363::root::(_getKeyPackages) rpm package glusterfs-fuse not found >Thread-15::DEBUG::2013-12-12 12:52:04,498::caps::363::root::(_getKeyPackages) rpm package gluster-swift not found >Thread-15::DEBUG::2013-12-12 12:52:04,499::caps::363::root::(_getKeyPackages) rpm package qemu-kvm-rhev not found >Thread-15::DEBUG::2013-12-12 12:52:04,500::caps::363::root::(_getKeyPackages) rpm package gluster-swift-object not found >Thread-15::DEBUG::2013-12-12 12:52:04,500::caps::363::root::(_getKeyPackages) rpm package glusterfs not found >Thread-15::DEBUG::2013-12-12 12:52:04,500::caps::363::root::(_getKeyPackages) rpm package gluster-swift-plugin not found >Thread-15::DEBUG::2013-12-12 12:52:04,501::caps::363::root::(_getKeyPackages) rpm package qemu-img-rhev not found >Thread-15::DEBUG::2013-12-12 12:52:04,502::caps::363::root::(_getKeyPackages) rpm package ('mom',) not found >Thread-15::DEBUG::2013-12-12 12:52:04,502::caps::363::root::(_getKeyPackages) rpm package gluster-swift-account not found >Thread-15::DEBUG::2013-12-12 12:52:04,502::caps::363::root::(_getKeyPackages) rpm package gluster-swift-proxy not found >Thread-15::DEBUG::2013-12-12 12:52:04,503::caps::363::root::(_getKeyPackages) rpm package gluster-swift-doc not found >Thread-15::DEBUG::2013-12-12 12:52:04,503::caps::363::root::(_getKeyPackages) rpm package glusterfs-server not found >Thread-15::DEBUG::2013-12-12 12:52:04,503::caps::363::root::(_getKeyPackages) rpm package gluster-swift-container not found >Thread-15::DEBUG::2013-12-12 12:52:04,503::caps::363::root::(_getKeyPackages) rpm package glusterfs-geo-replication not found >Thread-15::DEBUG::2013-12-12 12:52:04,504::BindingXMLRPC::991::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.28.1.el6.x86_64', 'buildtime': 1384533955.0, 'version': '2.6.32'}, 'vdsm': {'release': '23.1.el6rhs', 'buildtime': 1386773756L, 'version': '4.13.0'}, 'spice-server': {'release': '12.el6_4.5', 'buildtime': 1381834662L, 'version': '0.12.0'}, 'libvirt': {'release': '18.el6_4.13', 'buildtime': 1379320058L, 'version': '0.10.2'}}, 'cpuModel': 'QEMU Virtual CPU version 1.4.2', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.14.16.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.14.16.254', 'ports': ['eth0']}}, 'uuid': '7B904C94-94EE-7B49-40B3-BD3C28FBB749', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'netmask': '', 'addr': '', 'hwaddr': '52:54:00:b7:60:bc', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': '52:54:00:b7:60:bc', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 100, 'mtu': '1500'}}, 'software_revision': '23.1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': 'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,lm,up,rep_good,unfair_spinlock,pni,cx16,popcnt,hypervisor,lahf_lm', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '4062', 'cpuSpeed': '2393.998', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '1', 'kvmEnabled': 'false', 'rhsVersion': {'release': '1.el6rhs', 'version': '2.1.2.0', 'name': 'RHS'}, 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '1', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.14.16.112'}} >Thread-16::DEBUG::2013-12-12 12:52:04,527::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getHardwareInfo with () {} >Thread-16::DEBUG::2013-12-12 12:52:04,567::BindingXMLRPC::991::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'Bochs', 'systemSerialNumber': 'Not Specified', 'systemFamily': 'Not Specified', 'systemVersion': 'Not Specified', 'systemUUID': '7b904c94-94ee-7b49-40b3-bd3c28fbb749', 'systemManufacturer': 'Bochs'}} >Thread-17::DEBUG::2013-12-12 12:52:04,602::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-17::DEBUG::2013-12-12 12:52:05,331::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-18::DEBUG::2013-12-12 12:52:05,341::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getCapabilities with () {} >Thread-18::DEBUG::2013-12-12 12:52:05,341::utils::489::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-18::DEBUG::2013-12-12 12:52:05,348::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2013-12-12 12:52:05,361::caps::363::root::(_getKeyPackages) rpm package glusterfs-rdma not found >Thread-18::DEBUG::2013-12-12 12:52:05,362::caps::363::root::(_getKeyPackages) rpm package glusterfs-fuse not found >Thread-18::DEBUG::2013-12-12 12:52:05,362::caps::363::root::(_getKeyPackages) rpm package gluster-swift not found >Thread-18::DEBUG::2013-12-12 12:52:05,363::caps::363::root::(_getKeyPackages) rpm package qemu-kvm-rhev not found >Thread-18::DEBUG::2013-12-12 12:52:05,363::caps::363::root::(_getKeyPackages) rpm package gluster-swift-object not found >Thread-18::DEBUG::2013-12-12 12:52:05,363::caps::363::root::(_getKeyPackages) rpm package glusterfs not found >Thread-18::DEBUG::2013-12-12 12:52:05,364::caps::363::root::(_getKeyPackages) rpm package gluster-swift-plugin not found >Thread-18::DEBUG::2013-12-12 12:52:05,365::caps::363::root::(_getKeyPackages) rpm package qemu-img-rhev not found >Thread-18::DEBUG::2013-12-12 12:52:05,365::caps::363::root::(_getKeyPackages) rpm package ('mom',) not found >Thread-18::DEBUG::2013-12-12 12:52:05,366::caps::363::root::(_getKeyPackages) rpm package gluster-swift-account not found >Thread-18::DEBUG::2013-12-12 12:52:05,366::caps::363::root::(_getKeyPackages) rpm package gluster-swift-proxy not found >Thread-18::DEBUG::2013-12-12 12:52:05,366::caps::363::root::(_getKeyPackages) rpm package gluster-swift-doc not found >Thread-18::DEBUG::2013-12-12 12:52:05,366::caps::363::root::(_getKeyPackages) rpm package glusterfs-server not found >Thread-18::DEBUG::2013-12-12 12:52:05,367::caps::363::root::(_getKeyPackages) rpm package gluster-swift-container not found >Thread-18::DEBUG::2013-12-12 12:52:05,367::caps::363::root::(_getKeyPackages) rpm package glusterfs-geo-replication not found >Thread-18::DEBUG::2013-12-12 12:52:05,368::BindingXMLRPC::991::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.28.1.el6.x86_64', 'buildtime': 1384533955.0, 'version': '2.6.32'}, 'vdsm': {'release': '23.1.el6rhs', 'buildtime': 1386773756L, 'version': '4.13.0'}, 'spice-server': {'release': '12.el6_4.5', 'buildtime': 1381834662L, 'version': '0.12.0'}, 'libvirt': {'release': '18.el6_4.13', 'buildtime': 1379320058L, 'version': '0.10.2'}}, 'cpuModel': 'QEMU Virtual CPU version 1.4.2', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.14.16.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.14.16.254', 'ports': ['eth0']}}, 'uuid': '7B904C94-94EE-7B49-40B3-BD3C28FBB749', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'netmask': '', 'addr': '', 'hwaddr': '52:54:00:b7:60:bc', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': '52:54:00:b7:60:bc', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 100, 'mtu': '1500'}}, 'software_revision': '23.1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': 'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,lm,up,rep_good,unfair_spinlock,pni,cx16,popcnt,hypervisor,lahf_lm', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '4062', 'cpuSpeed': '2393.998', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '1', 'kvmEnabled': 'false', 'rhsVersion': {'release': '1.el6rhs', 'version': '2.1.2.0', 'name': 'RHS'}, 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '1', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.14.16.112'}} >Thread-19::DEBUG::2013-12-12 12:52:05,382::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getHardwareInfo with () {} >Thread-19::DEBUG::2013-12-12 12:52:05,384::BindingXMLRPC::991::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'Bochs', 'systemSerialNumber': 'Not Specified', 'systemFamily': 'Not Specified', 'systemVersion': 'Not Specified', 'systemUUID': '7b904c94-94ee-7b49-40b3-bd3c28fbb749', 'systemManufacturer': 'Bochs'}} >Thread-20::DEBUG::2013-12-12 12:52:05,415::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-20::DEBUG::2013-12-12 12:52:05,796::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-22::DEBUG::2013-12-12 12:52:05,821::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostUUIDGet with () {} flowID [2b5c035b] >Thread-22::DEBUG::2013-12-12 12:52:06,075::BindingXMLRPC::991::vds::(wrapper) return hostUUIDGet with {'status': {'message': 'Done', 'code': 0}, 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'} >storageRefresh::DEBUG::2013-12-12 12:52:07,645::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >storageRefresh::DEBUG::2013-12-12 12:52:07,677::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 12:52:07,677::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 12:52:07,677::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 12:52:07,678::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 12:52:07,678::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 12:52:07,678::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 12:52:07,678::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 12:52:07,679::misc::819::SamplingMethod::(__call__) Returning last result >storageRefresh::WARNING::2013-12-12 12:52:07,679::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >Thread-23::DEBUG::2013-12-12 12:52:09,461::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >KsmMonitor::DEBUG::2013-12-12 12:52:09,619::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2013-12-12 12:52:09,619::utils::489::root::(execCmd) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2013-12-12 12:52:09,688::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-23::DEBUG::2013-12-12 12:52:09,900::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-25::DEBUG::2013-12-12 12:52:09,910::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-25::DEBUG::2013-12-12 12:52:10,110::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'user.cifs': 'enable', 'nfs.disable': 'off', 'auth.allow': '*'}}}} >Thread-26::DEBUG::2013-12-12 12:52:12,649::task::579::TaskManager.Task::(_updateState) Task=`6173696f-8792-4a16-bd12-8139aca70d1e`::moving from state init -> state preparing >Thread-26::INFO::2013-12-12 12:52:12,650::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-26::INFO::2013-12-12 12:52:12,650::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-26::DEBUG::2013-12-12 12:52:12,650::task::1168::TaskManager.Task::(prepare) Task=`6173696f-8792-4a16-bd12-8139aca70d1e`::finished: {} >Thread-26::DEBUG::2013-12-12 12:52:12,650::task::579::TaskManager.Task::(_updateState) Task=`6173696f-8792-4a16-bd12-8139aca70d1e`::moving from state preparing -> state finished >Thread-26::DEBUG::2013-12-12 12:52:12,650::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26::DEBUG::2013-12-12 12:52:12,651::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26::DEBUG::2013-12-12 12:52:12,651::task::974::TaskManager.Task::(_decref) Task=`6173696f-8792-4a16-bd12-8139aca70d1e`::ref 0 aborting False >Thread-30::DEBUG::2013-12-12 12:52:20,912::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-30::DEBUG::2013-12-12 12:52:21,287::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-31::DEBUG::2013-12-12 12:52:21,299::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-31::DEBUG::2013-12-12 12:52:21,522::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'blah': {'transportType': ['TCP'], 'uuid': '1bb7cfaf-2110-4058-96cd-58cc7caacec0', 'bricks': ['latest-a:/bricks/123123', 'latest-a:/bricks/12312312', 'latest-a:/bricks/12312323', 'latest-b:/bricks/sadfsadfsdaf', 'latest-b:/bricks/asdfsadf', 'latest-b:/bricks/adsfsadf'], 'volumeName': 'blah', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'user.cifs': 'enable', 'nfs.disable': 'off', 'auth.allow': '*'}}}} >Thread-34::DEBUG::2013-12-12 12:52:27,952::task::579::TaskManager.Task::(_updateState) Task=`d0e5920d-f843-47d6-ad40-7fe4c0ca3b6b`::moving from state init -> state preparing >Thread-34::INFO::2013-12-12 12:52:27,952::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-34::INFO::2013-12-12 12:52:27,952::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-34::DEBUG::2013-12-12 12:52:27,953::task::1168::TaskManager.Task::(prepare) Task=`d0e5920d-f843-47d6-ad40-7fe4c0ca3b6b`::finished: {} >Thread-34::DEBUG::2013-12-12 12:52:27,953::task::579::TaskManager.Task::(_updateState) Task=`d0e5920d-f843-47d6-ad40-7fe4c0ca3b6b`::moving from state preparing -> state finished >Thread-34::DEBUG::2013-12-12 12:52:27,953::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-34::DEBUG::2013-12-12 12:52:27,953::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2013-12-12 12:52:27,953::task::974::TaskManager.Task::(_decref) Task=`d0e5920d-f843-47d6-ad40-7fe4c0ca3b6b`::ref 0 aborting False >Thread-37::DEBUG::2013-12-12 12:52:32,120::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-37::DEBUG::2013-12-12 12:52:32,701::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-38::DEBUG::2013-12-12 12:52:32,710::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-38::DEBUG::2013-12-12 12:52:32,880::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-42::DEBUG::2013-12-12 12:52:43,072::task::579::TaskManager.Task::(_updateState) Task=`cc19797a-d634-47e5-a195-94ef08b828c2`::moving from state init -> state preparing >Thread-42::INFO::2013-12-12 12:52:43,072::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-42::INFO::2013-12-12 12:52:43,072::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-42::DEBUG::2013-12-12 12:52:43,073::task::1168::TaskManager.Task::(prepare) Task=`cc19797a-d634-47e5-a195-94ef08b828c2`::finished: {} >Thread-42::DEBUG::2013-12-12 12:52:43,073::task::579::TaskManager.Task::(_updateState) Task=`cc19797a-d634-47e5-a195-94ef08b828c2`::moving from state preparing -> state finished >Thread-42::DEBUG::2013-12-12 12:52:43,073::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-42::DEBUG::2013-12-12 12:52:43,073::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-42::DEBUG::2013-12-12 12:52:43,073::task::974::TaskManager.Task::(_decref) Task=`cc19797a-d634-47e5-a195-94ef08b828c2`::ref 0 aborting False >Thread-44::DEBUG::2013-12-12 12:52:43,673::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-44::DEBUG::2013-12-12 12:52:44,152::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-45::DEBUG::2013-12-12 12:52:44,162::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-45::DEBUG::2013-12-12 12:52:44,334::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-49::DEBUG::2013-12-12 12:52:54,991::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-49::DEBUG::2013-12-12 12:52:55,345::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-51::DEBUG::2013-12-12 12:52:55,356::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-51::DEBUG::2013-12-12 12:52:55,592::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-52::DEBUG::2013-12-12 12:52:57,317::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-52::DEBUG::2013-12-12 12:52:57,499::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-53::DEBUG::2013-12-12 12:52:58,234::task::579::TaskManager.Task::(_updateState) Task=`e2069388-b7a5-4f12-9600-ba89b4d5e118`::moving from state init -> state preparing >Thread-53::INFO::2013-12-12 12:52:58,234::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53::INFO::2013-12-12 12:52:58,234::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-53::DEBUG::2013-12-12 12:52:58,234::task::1168::TaskManager.Task::(prepare) Task=`e2069388-b7a5-4f12-9600-ba89b4d5e118`::finished: {} >Thread-53::DEBUG::2013-12-12 12:52:58,234::task::579::TaskManager.Task::(_updateState) Task=`e2069388-b7a5-4f12-9600-ba89b4d5e118`::moving from state preparing -> state finished >Thread-53::DEBUG::2013-12-12 12:52:58,235::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53::DEBUG::2013-12-12 12:52:58,235::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53::DEBUG::2013-12-12 12:52:58,235::task::974::TaskManager.Task::(_decref) Task=`e2069388-b7a5-4f12-9600-ba89b4d5e118`::ref 0 aborting False >Thread-55::DEBUG::2013-12-12 12:53:00,608::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-55::DEBUG::2013-12-12 12:53:00,965::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-56::DEBUG::2013-12-12 12:53:00,974::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-56::DEBUG::2013-12-12 12:53:01,285::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-59::DEBUG::2013-12-12 12:53:06,302::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-59::DEBUG::2013-12-12 12:53:06,644::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-60::DEBUG::2013-12-12 12:53:06,654::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-60::DEBUG::2013-12-12 12:53:06,846::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-63::DEBUG::2013-12-12 12:53:11,860::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-63::DEBUG::2013-12-12 12:53:12,214::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-64::DEBUG::2013-12-12 12:53:12,222::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-64::DEBUG::2013-12-12 12:53:12,537::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-65::DEBUG::2013-12-12 12:53:13,405::task::579::TaskManager.Task::(_updateState) Task=`4ed3e4de-db7a-4a6e-b08e-a7a263cdcdcf`::moving from state init -> state preparing >Thread-65::INFO::2013-12-12 12:53:13,405::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-65::INFO::2013-12-12 12:53:13,405::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-65::DEBUG::2013-12-12 12:53:13,405::task::1168::TaskManager.Task::(prepare) Task=`4ed3e4de-db7a-4a6e-b08e-a7a263cdcdcf`::finished: {} >Thread-65::DEBUG::2013-12-12 12:53:13,405::task::579::TaskManager.Task::(_updateState) Task=`4ed3e4de-db7a-4a6e-b08e-a7a263cdcdcf`::moving from state preparing -> state finished >Thread-65::DEBUG::2013-12-12 12:53:13,405::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-65::DEBUG::2013-12-12 12:53:13,406::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-65::DEBUG::2013-12-12 12:53:13,406::task::974::TaskManager.Task::(_decref) Task=`4ed3e4de-db7a-4a6e-b08e-a7a263cdcdcf`::ref 0 aborting False >Thread-68::DEBUG::2013-12-12 12:53:17,553::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-68::DEBUG::2013-12-12 12:53:17,934::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-69::DEBUG::2013-12-12 12:53:17,943::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-69::DEBUG::2013-12-12 12:53:18,123::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-73::DEBUG::2013-12-12 12:53:28,565::task::579::TaskManager.Task::(_updateState) Task=`d04df647-1413-411b-b829-9346d967fd95`::moving from state init -> state preparing >Thread-73::INFO::2013-12-12 12:53:28,566::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-73::INFO::2013-12-12 12:53:28,566::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-73::DEBUG::2013-12-12 12:53:28,566::task::1168::TaskManager.Task::(prepare) Task=`d04df647-1413-411b-b829-9346d967fd95`::finished: {} >Thread-73::DEBUG::2013-12-12 12:53:28,566::task::579::TaskManager.Task::(_updateState) Task=`d04df647-1413-411b-b829-9346d967fd95`::moving from state preparing -> state finished >Thread-73::DEBUG::2013-12-12 12:53:28,567::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2013-12-12 12:53:28,567::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2013-12-12 12:53:28,567::task::974::TaskManager.Task::(_decref) Task=`d04df647-1413-411b-b829-9346d967fd95`::ref 0 aborting False >Thread-75::DEBUG::2013-12-12 12:53:28,741::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-75::DEBUG::2013-12-12 12:53:29,399::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-76::DEBUG::2013-12-12 12:53:29,408::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-76::DEBUG::2013-12-12 12:53:29,577::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-81::DEBUG::2013-12-12 12:53:43,739::task::579::TaskManager.Task::(_updateState) Task=`e95505a5-178c-4720-ba06-33a7a61396d8`::moving from state init -> state preparing >Thread-81::INFO::2013-12-12 12:53:43,739::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-81::INFO::2013-12-12 12:53:43,739::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-81::DEBUG::2013-12-12 12:53:43,740::task::1168::TaskManager.Task::(prepare) Task=`e95505a5-178c-4720-ba06-33a7a61396d8`::finished: {} >Thread-81::DEBUG::2013-12-12 12:53:43,740::task::579::TaskManager.Task::(_updateState) Task=`e95505a5-178c-4720-ba06-33a7a61396d8`::moving from state preparing -> state finished >Thread-81::DEBUG::2013-12-12 12:53:43,740::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-81::DEBUG::2013-12-12 12:53:43,740::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-81::DEBUG::2013-12-12 12:53:43,740::task::974::TaskManager.Task::(_decref) Task=`e95505a5-178c-4720-ba06-33a7a61396d8`::ref 0 aborting False >Thread-83::DEBUG::2013-12-12 12:53:46,222::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-83::DEBUG::2013-12-12 12:53:46,546::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-84::DEBUG::2013-12-12 12:53:46,554::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-84::DEBUG::2013-12-12 12:53:46,727::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-89::DEBUG::2013-12-12 12:53:57,558::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-89::DEBUG::2013-12-12 12:53:58,180::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-90::DEBUG::2013-12-12 12:53:58,189::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-90::DEBUG::2013-12-12 12:53:58,447::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-91::DEBUG::2013-12-12 12:53:58,909::task::579::TaskManager.Task::(_updateState) Task=`f53b9886-9282-4b1e-b093-539eae81e38d`::moving from state init -> state preparing >Thread-91::INFO::2013-12-12 12:53:58,909::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-91::INFO::2013-12-12 12:53:58,910::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-91::DEBUG::2013-12-12 12:53:58,910::task::1168::TaskManager.Task::(prepare) Task=`f53b9886-9282-4b1e-b093-539eae81e38d`::finished: {} >Thread-91::DEBUG::2013-12-12 12:53:58,910::task::579::TaskManager.Task::(_updateState) Task=`f53b9886-9282-4b1e-b093-539eae81e38d`::moving from state preparing -> state finished >Thread-91::DEBUG::2013-12-12 12:53:58,910::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-91::DEBUG::2013-12-12 12:53:58,910::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-91::DEBUG::2013-12-12 12:53:58,910::task::974::TaskManager.Task::(_decref) Task=`f53b9886-9282-4b1e-b093-539eae81e38d`::ref 0 aborting False >Thread-94::DEBUG::2013-12-12 12:54:03,459::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-94::DEBUG::2013-12-12 12:54:03,957::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-95::DEBUG::2013-12-12 12:54:03,971::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-95::DEBUG::2013-12-12 12:54:04,174::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-99::DEBUG::2013-12-12 12:54:14,068::task::579::TaskManager.Task::(_updateState) Task=`82b1177e-51ac-4f06-9004-8319b3ee7b30`::moving from state init -> state preparing >Thread-99::INFO::2013-12-12 12:54:14,068::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-99::INFO::2013-12-12 12:54:14,068::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-99::DEBUG::2013-12-12 12:54:14,068::task::1168::TaskManager.Task::(prepare) Task=`82b1177e-51ac-4f06-9004-8319b3ee7b30`::finished: {} >Thread-99::DEBUG::2013-12-12 12:54:14,068::task::579::TaskManager.Task::(_updateState) Task=`82b1177e-51ac-4f06-9004-8319b3ee7b30`::moving from state preparing -> state finished >Thread-99::DEBUG::2013-12-12 12:54:14,069::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-99::DEBUG::2013-12-12 12:54:14,069::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-99::DEBUG::2013-12-12 12:54:14,069::task::974::TaskManager.Task::(_decref) Task=`82b1177e-51ac-4f06-9004-8319b3ee7b30`::ref 0 aborting False >Thread-101::DEBUG::2013-12-12 12:54:15,090::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-101::DEBUG::2013-12-12 12:54:15,540::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-102::DEBUG::2013-12-12 12:54:15,552::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-102::DEBUG::2013-12-12 12:54:15,868::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-104::DEBUG::2013-12-12 12:54:18,928::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeCreate with ('boom', ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 0, 0, ['TCP'], False) {} flowID [6c77966f] >Thread-104::DEBUG::2013-12-12 12:54:23,619::BindingXMLRPC::991::vds::(wrapper) return volumeCreate with {'status': {'message': 'Done', 'code': 0}, 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28'} >Thread-108::DEBUG::2013-12-12 12:54:29,223::task::579::TaskManager.Task::(_updateState) Task=`91f10e41-ac3d-4c33-bb73-0e102a5cc663`::moving from state init -> state preparing >Thread-108::INFO::2013-12-12 12:54:29,223::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-108::INFO::2013-12-12 12:54:29,223::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-108::DEBUG::2013-12-12 12:54:29,223::task::1168::TaskManager.Task::(prepare) Task=`91f10e41-ac3d-4c33-bb73-0e102a5cc663`::finished: {} >Thread-108::DEBUG::2013-12-12 12:54:29,224::task::579::TaskManager.Task::(_updateState) Task=`91f10e41-ac3d-4c33-bb73-0e102a5cc663`::moving from state preparing -> state finished >Thread-108::DEBUG::2013-12-12 12:54:29,224::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-108::DEBUG::2013-12-12 12:54:29,224::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-108::DEBUG::2013-12-12 12:54:29,224::task::974::TaskManager.Task::(_decref) Task=`91f10e41-ac3d-4c33-bb73-0e102a5cc663`::ref 0 aborting False >Thread-111::DEBUG::2013-12-12 12:54:33,555::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeSet with ('boom', 'auth.allow', '*') {} flowID [4c9fd9d6] >Thread-111::DEBUG::2013-12-12 12:54:38,714::BindingXMLRPC::991::vds::(wrapper) return volumeSet with {'status': {'message': 'Done', 'code': 0}} >Thread-115::DEBUG::2013-12-12 12:54:44,552::task::579::TaskManager.Task::(_updateState) Task=`9c5f3c28-0815-4aaa-b4c0-888c810fb981`::moving from state init -> state preparing >Thread-115::INFO::2013-12-12 12:54:44,552::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-115::INFO::2013-12-12 12:54:44,553::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-115::DEBUG::2013-12-12 12:54:44,553::task::1168::TaskManager.Task::(prepare) Task=`9c5f3c28-0815-4aaa-b4c0-888c810fb981`::finished: {} >Thread-115::DEBUG::2013-12-12 12:54:44,553::task::579::TaskManager.Task::(_updateState) Task=`9c5f3c28-0815-4aaa-b4c0-888c810fb981`::moving from state preparing -> state finished >Thread-115::DEBUG::2013-12-12 12:54:44,553::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-115::DEBUG::2013-12-12 12:54:44,553::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-115::DEBUG::2013-12-12 12:54:44,553::task::974::TaskManager.Task::(_decref) Task=`9c5f3c28-0815-4aaa-b4c0-888c810fb981`::ref 0 aborting False >Thread-118::DEBUG::2013-12-12 12:54:50,148::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-118::DEBUG::2013-12-12 12:54:50,619::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-119::DEBUG::2013-12-12 12:54:50,629::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-119::DEBUG::2013-12-12 12:54:50,875::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-123::DEBUG::2013-12-12 12:54:57,996::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-123::DEBUG::2013-12-12 12:54:58,214::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-124::DEBUG::2013-12-12 12:54:59,815::task::579::TaskManager.Task::(_updateState) Task=`3a57277c-78a0-43ea-a994-6907f9f61b44`::moving from state init -> state preparing >Thread-124::INFO::2013-12-12 12:54:59,816::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-124::INFO::2013-12-12 12:54:59,816::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-124::DEBUG::2013-12-12 12:54:59,816::task::1168::TaskManager.Task::(prepare) Task=`3a57277c-78a0-43ea-a994-6907f9f61b44`::finished: {} >Thread-124::DEBUG::2013-12-12 12:54:59,816::task::579::TaskManager.Task::(_updateState) Task=`3a57277c-78a0-43ea-a994-6907f9f61b44`::moving from state preparing -> state finished >Thread-124::DEBUG::2013-12-12 12:54:59,816::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-124::DEBUG::2013-12-12 12:54:59,817::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-124::DEBUG::2013-12-12 12:54:59,817::task::974::TaskManager.Task::(_decref) Task=`3a57277c-78a0-43ea-a994-6907f9f61b44`::ref 0 aborting False >Thread-126::DEBUG::2013-12-12 12:55:01,956::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-126::DEBUG::2013-12-12 12:55:02,302::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-127::DEBUG::2013-12-12 12:55:02,313::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-127::DEBUG::2013-12-12 12:55:02,670::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-132::DEBUG::2013-12-12 12:55:14,105::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeStart with ('boom', False) {} flowID [3d59bd0b] >Thread-133::DEBUG::2013-12-12 12:55:15,028::task::579::TaskManager.Task::(_updateState) Task=`4b034a27-4daa-4135-9d67-4628cacd357a`::moving from state init -> state preparing >Thread-133::INFO::2013-12-12 12:55:15,028::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-133::INFO::2013-12-12 12:55:15,029::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-133::DEBUG::2013-12-12 12:55:15,029::task::1168::TaskManager.Task::(prepare) Task=`4b034a27-4daa-4135-9d67-4628cacd357a`::finished: {} >Thread-133::DEBUG::2013-12-12 12:55:15,029::task::579::TaskManager.Task::(_updateState) Task=`4b034a27-4daa-4135-9d67-4628cacd357a`::moving from state preparing -> state finished >Thread-133::DEBUG::2013-12-12 12:55:15,029::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-133::DEBUG::2013-12-12 12:55:15,029::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-133::DEBUG::2013-12-12 12:55:15,029::task::974::TaskManager.Task::(_decref) Task=`4b034a27-4daa-4135-9d67-4628cacd357a`::ref 0 aborting False >Thread-132::ERROR::2013-12-12 12:55:16,915::BindingXMLRPC::1000::vds::(wrapper) vdsm exception occured >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 989, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 53, in wrapper > rv = func(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 89, in volumeStart > self.svdsmProxy.glusterVolumeStart(volumeName, force) > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in glusterVolumeStart > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >GlusterVolumeStartFailedException: Volume start failed >error: volume start: boom: failed: Commit failed on 10.14.16.132. Please check log file for details. >return code: 1 >Thread-136::DEBUG::2013-12-12 12:55:19,027::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-136::DEBUG::2013-12-12 12:55:19,519::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-137::DEBUG::2013-12-12 12:55:19,530::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-137::DEBUG::2013-12-12 12:55:19,826::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-141::DEBUG::2013-12-12 12:55:30,299::task::579::TaskManager.Task::(_updateState) Task=`aa9ca362-7b7e-43b9-ac2b-98b316343350`::moving from state init -> state preparing >Thread-141::INFO::2013-12-12 12:55:30,300::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-141::INFO::2013-12-12 12:55:30,300::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-141::DEBUG::2013-12-12 12:55:30,300::task::1168::TaskManager.Task::(prepare) Task=`aa9ca362-7b7e-43b9-ac2b-98b316343350`::finished: {} >Thread-141::DEBUG::2013-12-12 12:55:30,300::task::579::TaskManager.Task::(_updateState) Task=`aa9ca362-7b7e-43b9-ac2b-98b316343350`::moving from state preparing -> state finished >Thread-141::DEBUG::2013-12-12 12:55:30,300::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-141::DEBUG::2013-12-12 12:55:30,300::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-141::DEBUG::2013-12-12 12:55:30,301::task::974::TaskManager.Task::(_decref) Task=`aa9ca362-7b7e-43b9-ac2b-98b316343350`::ref 0 aborting False >Thread-143::DEBUG::2013-12-12 12:55:30,725::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-143::DEBUG::2013-12-12 12:55:31,074::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-144::DEBUG::2013-12-12 12:55:31,084::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-144::DEBUG::2013-12-12 12:55:31,445::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-149::DEBUG::2013-12-12 12:55:45,533::task::579::TaskManager.Task::(_updateState) Task=`ffe0cf4a-43cf-42f2-94da-f45b7841f66b`::moving from state init -> state preparing >Thread-149::INFO::2013-12-12 12:55:45,533::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-149::INFO::2013-12-12 12:55:45,534::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-149::DEBUG::2013-12-12 12:55:45,534::task::1168::TaskManager.Task::(prepare) Task=`ffe0cf4a-43cf-42f2-94da-f45b7841f66b`::finished: {} >Thread-149::DEBUG::2013-12-12 12:55:45,534::task::579::TaskManager.Task::(_updateState) Task=`ffe0cf4a-43cf-42f2-94da-f45b7841f66b`::moving from state preparing -> state finished >Thread-149::DEBUG::2013-12-12 12:55:45,534::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-149::DEBUG::2013-12-12 12:55:45,534::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-149::DEBUG::2013-12-12 12:55:45,534::task::974::TaskManager.Task::(_decref) Task=`ffe0cf4a-43cf-42f2-94da-f45b7841f66b`::ref 0 aborting False >Thread-155::DEBUG::2013-12-12 12:55:58,228::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-155::DEBUG::2013-12-12 12:55:58,461::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-156::DEBUG::2013-12-12 12:55:59,728::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-156::DEBUG::2013-12-12 12:56:00,140::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-157::DEBUG::2013-12-12 12:56:00,151::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-157::DEBUG::2013-12-12 12:56:00,427::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-158::DEBUG::2013-12-12 12:56:00,703::task::579::TaskManager.Task::(_updateState) Task=`355afcb2-b345-4e25-ba56-bccca3c1f196`::moving from state init -> state preparing >Thread-158::INFO::2013-12-12 12:56:00,703::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-158::INFO::2013-12-12 12:56:00,703::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-158::DEBUG::2013-12-12 12:56:00,703::task::1168::TaskManager.Task::(prepare) Task=`355afcb2-b345-4e25-ba56-bccca3c1f196`::finished: {} >Thread-158::DEBUG::2013-12-12 12:56:00,704::task::579::TaskManager.Task::(_updateState) Task=`355afcb2-b345-4e25-ba56-bccca3c1f196`::moving from state preparing -> state finished >Thread-158::DEBUG::2013-12-12 12:56:00,704::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-158::DEBUG::2013-12-12 12:56:00,704::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-158::DEBUG::2013-12-12 12:56:00,704::task::974::TaskManager.Task::(_decref) Task=`355afcb2-b345-4e25-ba56-bccca3c1f196`::ref 0 aborting False >Thread-163::DEBUG::2013-12-12 12:56:11,231::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} flowID [21d4fcb4] >Thread-163::DEBUG::2013-12-12 12:56:11,773::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-164::DEBUG::2013-12-12 12:56:11,784::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} flowID [21d4fcb4] >Thread-164::DEBUG::2013-12-12 12:56:12,126::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-166::DEBUG::2013-12-12 12:56:15,874::task::579::TaskManager.Task::(_updateState) Task=`ce11d4d8-e6c7-4263-9fda-dda223be10f8`::moving from state init -> state preparing >Thread-166::INFO::2013-12-12 12:56:15,874::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-166::INFO::2013-12-12 12:56:15,874::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-166::DEBUG::2013-12-12 12:56:15,875::task::1168::TaskManager.Task::(prepare) Task=`ce11d4d8-e6c7-4263-9fda-dda223be10f8`::finished: {} >Thread-166::DEBUG::2013-12-12 12:56:15,875::task::579::TaskManager.Task::(_updateState) Task=`ce11d4d8-e6c7-4263-9fda-dda223be10f8`::moving from state preparing -> state finished >Thread-166::DEBUG::2013-12-12 12:56:15,875::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-166::DEBUG::2013-12-12 12:56:15,875::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-166::DEBUG::2013-12-12 12:56:15,875::task::974::TaskManager.Task::(_decref) Task=`ce11d4d8-e6c7-4263-9fda-dda223be10f8`::ref 0 aborting False >Thread-170::DEBUG::2013-12-12 12:56:23,251::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-170::DEBUG::2013-12-12 12:56:23,736::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-171::DEBUG::2013-12-12 12:56:23,746::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-171::DEBUG::2013-12-12 12:56:23,993::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-174::DEBUG::2013-12-12 12:56:29,121::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-174::DEBUG::2013-12-12 12:56:29,579::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-175::DEBUG::2013-12-12 12:56:29,587::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-175::DEBUG::2013-12-12 12:56:29,761::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-176::DEBUG::2013-12-12 12:56:30,980::task::579::TaskManager.Task::(_updateState) Task=`c8762c60-8940-4438-b5d4-17f46e54f394`::moving from state init -> state preparing >Thread-176::INFO::2013-12-12 12:56:30,981::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-176::INFO::2013-12-12 12:56:30,981::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-176::DEBUG::2013-12-12 12:56:30,981::task::1168::TaskManager.Task::(prepare) Task=`c8762c60-8940-4438-b5d4-17f46e54f394`::finished: {} >Thread-176::DEBUG::2013-12-12 12:56:30,981::task::579::TaskManager.Task::(_updateState) Task=`c8762c60-8940-4438-b5d4-17f46e54f394`::moving from state preparing -> state finished >Thread-176::DEBUG::2013-12-12 12:56:30,981::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-176::DEBUG::2013-12-12 12:56:30,981::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-176::DEBUG::2013-12-12 12:56:30,982::task::974::TaskManager.Task::(_decref) Task=`c8762c60-8940-4438-b5d4-17f46e54f394`::ref 0 aborting False >Thread-181::DEBUG::2013-12-12 12:56:40,467::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-181::DEBUG::2013-12-12 12:56:41,051::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-182::DEBUG::2013-12-12 12:56:41,059::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-182::DEBUG::2013-12-12 12:56:41,257::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-184::DEBUG::2013-12-12 12:56:46,132::task::579::TaskManager.Task::(_updateState) Task=`8bc271d3-3657-43a5-8f7c-45299e8ce60f`::moving from state init -> state preparing >Thread-184::INFO::2013-12-12 12:56:46,132::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-184::INFO::2013-12-12 12:56:46,132::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-184::DEBUG::2013-12-12 12:56:46,133::task::1168::TaskManager.Task::(prepare) Task=`8bc271d3-3657-43a5-8f7c-45299e8ce60f`::finished: {} >Thread-184::DEBUG::2013-12-12 12:56:46,133::task::579::TaskManager.Task::(_updateState) Task=`8bc271d3-3657-43a5-8f7c-45299e8ce60f`::moving from state preparing -> state finished >Thread-184::DEBUG::2013-12-12 12:56:46,133::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184::DEBUG::2013-12-12 12:56:46,133::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184::DEBUG::2013-12-12 12:56:46,133::task::974::TaskManager.Task::(_decref) Task=`8bc271d3-3657-43a5-8f7c-45299e8ce60f`::ref 0 aborting False >Thread-186::DEBUG::2013-12-12 12:56:46,357::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-186::DEBUG::2013-12-12 12:56:46,816::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-187::DEBUG::2013-12-12 12:56:46,826::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-187::DEBUG::2013-12-12 12:56:47,006::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-189::DEBUG::2013-12-12 12:56:52,027::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-189::DEBUG::2013-12-12 12:56:52,384::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-191::DEBUG::2013-12-12 12:56:52,399::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-191::DEBUG::2013-12-12 12:56:52,673::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-193::DEBUG::2013-12-12 12:56:57,694::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-193::DEBUG::2013-12-12 12:56:58,200::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-194::DEBUG::2013-12-12 12:56:58,214::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-194::DEBUG::2013-12-12 12:56:58,473::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-196::DEBUG::2013-12-12 12:57:01,287::task::579::TaskManager.Task::(_updateState) Task=`983082a3-ed38-4277-9724-b30771daa53c`::moving from state init -> state preparing >Thread-196::INFO::2013-12-12 12:57:01,287::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-196::INFO::2013-12-12 12:57:01,287::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-196::DEBUG::2013-12-12 12:57:01,287::task::1168::TaskManager.Task::(prepare) Task=`983082a3-ed38-4277-9724-b30771daa53c`::finished: {} >Thread-196::DEBUG::2013-12-12 12:57:01,287::task::579::TaskManager.Task::(_updateState) Task=`983082a3-ed38-4277-9724-b30771daa53c`::moving from state preparing -> state finished >Thread-196::DEBUG::2013-12-12 12:57:01,288::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-196::DEBUG::2013-12-12 12:57:01,288::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-196::DEBUG::2013-12-12 12:57:01,288::task::974::TaskManager.Task::(_decref) Task=`983082a3-ed38-4277-9724-b30771daa53c`::ref 0 aborting False >Thread-198::DEBUG::2013-12-12 12:57:03,496::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-198::DEBUG::2013-12-12 12:57:03,893::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-199::DEBUG::2013-12-12 12:57:03,901::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-199::DEBUG::2013-12-12 12:57:04,247::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-204::DEBUG::2013-12-12 12:57:16,441::task::579::TaskManager.Task::(_updateState) Task=`35009415-d7dc-438d-9a43-9864bc16e395`::moving from state init -> state preparing >Thread-204::INFO::2013-12-12 12:57:16,441::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-204::INFO::2013-12-12 12:57:16,441::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-204::DEBUG::2013-12-12 12:57:16,442::task::1168::TaskManager.Task::(prepare) Task=`35009415-d7dc-438d-9a43-9864bc16e395`::finished: {} >Thread-204::DEBUG::2013-12-12 12:57:16,442::task::579::TaskManager.Task::(_updateState) Task=`35009415-d7dc-438d-9a43-9864bc16e395`::moving from state preparing -> state finished >Thread-204::DEBUG::2013-12-12 12:57:16,442::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-204::DEBUG::2013-12-12 12:57:16,442::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-204::DEBUG::2013-12-12 12:57:16,442::task::974::TaskManager.Task::(_decref) Task=`35009415-d7dc-438d-9a43-9864bc16e395`::ref 0 aborting False >Thread-209::DEBUG::2013-12-12 12:57:26,365::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-209::DEBUG::2013-12-12 12:57:26,742::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-210::DEBUG::2013-12-12 12:57:26,749::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-210::DEBUG::2013-12-12 12:57:26,916::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-212::DEBUG::2013-12-12 12:57:31,651::task::579::TaskManager.Task::(_updateState) Task=`3826fb17-e2be-4640-9415-6f36d1cb1478`::moving from state init -> state preparing >Thread-212::INFO::2013-12-12 12:57:31,652::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-212::INFO::2013-12-12 12:57:31,652::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-212::DEBUG::2013-12-12 12:57:31,652::task::1168::TaskManager.Task::(prepare) Task=`3826fb17-e2be-4640-9415-6f36d1cb1478`::finished: {} >Thread-212::DEBUG::2013-12-12 12:57:31,652::task::579::TaskManager.Task::(_updateState) Task=`3826fb17-e2be-4640-9415-6f36d1cb1478`::moving from state preparing -> state finished >Thread-212::DEBUG::2013-12-12 12:57:31,652::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-212::DEBUG::2013-12-12 12:57:31,652::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-212::DEBUG::2013-12-12 12:57:31,653::task::974::TaskManager.Task::(_decref) Task=`3826fb17-e2be-4640-9415-6f36d1cb1478`::ref 0 aborting False >Thread-214::DEBUG::2013-12-12 12:57:32,015::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-214::DEBUG::2013-12-12 12:57:32,344::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-215::DEBUG::2013-12-12 12:57:32,351::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-215::DEBUG::2013-12-12 12:57:32,570::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >MainThread::DEBUG::2013-12-12 12:57:32,819::vdsm::45::vds::(sigtermHandler) Received signal 15 >MainThread::INFO::2013-12-12 12:57:33,352::vmChannels::183::vds::(stop) VM channels listener was stopped. >MainThread::DEBUG::2013-12-12 12:57:33,352::task::579::TaskManager.Task::(_updateState) Task=`5733ae2c-917b-4429-86db-de8489f7f145`::moving from state init -> state preparing >MainThread::INFO::2013-12-12 12:57:33,353::logUtils::44::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2013-12-12 12:57:33,369::storageServer::698::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::INFO::2013-12-12 12:57:33,644::domainMonitor::126::Storage.DomainMonitor::(close) Stopping domain monitors >MainThread::DEBUG::2013-12-12 12:57:33,644::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2013-12-12 12:57:33,644::logUtils::47::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2013-12-12 12:57:33,645::task::1168::TaskManager.Task::(prepare) Task=`5733ae2c-917b-4429-86db-de8489f7f145`::finished: None >MainThread::DEBUG::2013-12-12 12:57:33,645::task::579::TaskManager.Task::(_updateState) Task=`5733ae2c-917b-4429-86db-de8489f7f145`::moving from state preparing -> state finished >MainThread::DEBUG::2013-12-12 12:57:33,645::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-12-12 12:57:33,645::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-12-12 12:57:33,645::task::974::TaskManager.Task::(_decref) Task=`5733ae2c-917b-4429-86db-de8489f7f145`::ref 0 aborting False >MainThread::INFO::2013-12-12 12:57:33,645::vdsm::107::vds::(run) VDSM main thread ended. Waiting for 13 other threads... >MainThread::INFO::2013-12-12 12:57:33,646::vdsm::111::vds::(run) <_MainThread(MainThread, started 140557160904448)> >MainThread::INFO::2013-12-12 12:57:33,646::vdsm::111::vds::(run) <Thread(libvirtEventLoop, started daemon 140557065533184)> >MainThread::INFO::2013-12-12 12:57:33,646::vdsm::111::vds::(run) <WorkerThread(Thread-10, started daemon 140556428637952)> >MainThread::INFO::2013-12-12 12:57:33,646::vdsm::111::vds::(run) <WorkerThread(Thread-8, started daemon 140556655113984)> >MainThread::INFO::2013-12-12 12:57:33,646::vdsm::111::vds::(run) <WorkerThread(Thread-5, started daemon 140556686583552)> >MainThread::INFO::2013-12-12 12:57:33,646::vdsm::111::vds::(run) <WorkerThread(Thread-7, started daemon 140556665603840)> >MainThread::INFO::2013-12-12 12:57:33,646::vdsm::111::vds::(run) <WorkerThread(Thread-3, started daemon 140556919265024)> >MainThread::INFO::2013-12-12 12:57:33,647::vdsm::111::vds::(run) <WorkerThread(Thread-9, started daemon 140556644624128)> >MainThread::INFO::2013-12-12 12:57:33,647::vdsm::111::vds::(run) <WorkerThread(Thread-2, started daemon 140556929754880)> >MainThread::INFO::2013-12-12 12:57:33,647::vdsm::111::vds::(run) <WorkerThread(Thread-1, started daemon 140556940244736)> >MainThread::INFO::2013-12-12 12:57:33,647::vdsm::111::vds::(run) <KsmMonitorThread(KsmMonitor, started daemon 140556386678528)> >MainThread::INFO::2013-12-12 12:57:33,647::vdsm::111::vds::(run) <WorkerThread(Thread-6, started daemon 140556676093696)> >MainThread::INFO::2013-12-12 12:57:33,647::vdsm::111::vds::(run) <WorkerThread(Thread-4, started daemon 140556697073408)> >MainThread::INFO::2013-12-12 12:57:33,647::vmChannels::183::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2013-12-12 12:57:33,648::vdsm::111::vds::(run) <Listener(VM Channels Listener, started daemon 140556294420224)> >MainThread::INFO::2013-12-12 12:58:12,971::vdsm::101::vds::(run) (PID: 2792) I am the actual vdsm 4.13.0-23.1.el6rhs rhs-21u2-20131208-b (2.6.32-358.28.1.el6.x86_64) >MainThread::DEBUG::2013-12-12 12:58:13,343::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2013-12-12 12:58:13,343::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2013-12-12 12:58:13,348::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2013-12-12 12:58:13,686::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::INFO::2013-12-12 12:58:13,697::multipath::134::Storage.Multipath::(isEnabled) Manual override for multipath.conf detected - preserving current configuration >MainThread::WARNING::2013-12-12 12:58:13,697::multipath::137::Storage.Multipath::(isEnabled) This manual override for multipath.conf was based on downrevved template. You are strongly advised to contact your support representatives >MainThread::DEBUG::2013-12-12 12:58:13,697::hsm::426::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2013-12-12 12:58:13,734::hsm::426::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-12-12 12:58:13,734::hsm::450::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2013-12-12 12:58:13,737::hsm::482::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2013-12-12 12:58:13,737::hsm::483::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2013-12-12 12:58:13,737::hsm::485::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2013-12-12 12:58:13,738::hsm::528::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2013-12-12 12:58:13,739::dispatcher::98::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >MainThread::DEBUG::2013-12-12 12:58:13,740::task::579::TaskManager.Task::(_updateState) Task=`a7590141-68c5-4b78-85eb-3e9ebfc19994`::moving from state init -> state preparing >MainThread::INFO::2013-12-12 12:58:13,740::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0x7f27a1b7e200>>) >MainThread::INFO::2013-12-12 12:58:13,740::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None >MainThread::DEBUG::2013-12-12 12:58:13,740::task::1168::TaskManager.Task::(prepare) Task=`a7590141-68c5-4b78-85eb-3e9ebfc19994`::finished: None >MainThread::DEBUG::2013-12-12 12:58:13,741::task::579::TaskManager.Task::(_updateState) Task=`a7590141-68c5-4b78-85eb-3e9ebfc19994`::moving from state preparing -> state finished >MainThread::DEBUG::2013-12-12 12:58:13,741::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-12-12 12:58:13,741::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-12-12 12:58:13,741::task::974::TaskManager.Task::(_decref) Task=`a7590141-68c5-4b78-85eb-3e9ebfc19994`::ref 0 aborting False >storageRefresh::DEBUG::2013-12-12 12:58:13,746::lvm::338::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 12:58:13,747::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::WARNING::2013-12-12 12:58:13,755::clientIF::196::vds::(_prepareMOM) MOM is not available, fallback to KsmMonitor >MainThread::DEBUG::2013-12-12 12:58:13,756::utils::489::root::(execCmd) '/usr/bin/pgrep -xf ksmd' (cwd None) >MainThread::DEBUG::2013-12-12 12:58:13,804::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2013-12-12 12:58:13,804::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 29 >storageRefresh::DEBUG::2013-12-12 12:58:13,822::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 12:58:13,822::lvm::363::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 12:58:13,822::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 12:58:13,823::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >KsmMonitor::DEBUG::2013-12-12 12:58:13,832::utils::489::root::(execCmd) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2013-12-12 12:58:13,842::vmChannels::187::vds::(settimeout) Setting channels' timeout to 30 seconds. >clientIFinit::DEBUG::2013-12-12 12:58:13,842::libvirtconnection::131::libvirtconnection::(get) trying to connect libvirt >VM Channels Listener::INFO::2013-12-12 12:58:13,860::vmChannels::170::vds::(run) Starting VM channels listener thread. >storageRefresh::DEBUG::2013-12-12 12:58:13,904::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 12:58:13,904::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 12:58:13,905::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >storageRefresh::DEBUG::2013-12-12 12:58:13,995::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 12:58:13,996::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 12:58:13,996::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >storageRefresh::DEBUG::2013-12-12 12:58:14,061::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 12:58:14,061::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 12:58:14,062::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >storageRefresh::DEBUG::2013-12-12 12:58:14,062::misc::811::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-12-12 12:58:14,062::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2013-12-12 12:58:14,062::misc::811::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-12-12 12:58:14,062::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2013-12-12 12:58:14,111::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >storageRefresh::DEBUG::2013-12-12 12:58:14,111::misc::819::SamplingMethod::(__call__) Returning last result >Thread-13::DEBUG::2013-12-12 12:58:15,504::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getCapabilities with () {} >Thread-13::DEBUG::2013-12-12 12:58:15,570::utils::489::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-13::DEBUG::2013-12-12 12:58:15,590::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2013-12-12 12:58:15,631::caps::363::root::(_getKeyPackages) rpm package glusterfs-rdma not found >Thread-13::DEBUG::2013-12-12 12:58:15,631::caps::363::root::(_getKeyPackages) rpm package glusterfs-fuse not found >Thread-13::DEBUG::2013-12-12 12:58:15,632::caps::363::root::(_getKeyPackages) rpm package gluster-swift not found >Thread-13::DEBUG::2013-12-12 12:58:15,633::caps::363::root::(_getKeyPackages) rpm package qemu-kvm-rhev not found >Thread-13::DEBUG::2013-12-12 12:58:15,633::caps::363::root::(_getKeyPackages) rpm package gluster-swift-object not found >Thread-13::DEBUG::2013-12-12 12:58:15,634::caps::363::root::(_getKeyPackages) rpm package glusterfs not found >Thread-13::DEBUG::2013-12-12 12:58:15,634::caps::363::root::(_getKeyPackages) rpm package gluster-swift-plugin not found >Thread-13::DEBUG::2013-12-12 12:58:15,635::caps::363::root::(_getKeyPackages) rpm package qemu-img-rhev not found >Thread-13::DEBUG::2013-12-12 12:58:15,635::caps::363::root::(_getKeyPackages) rpm package ('mom',) not found >Thread-13::DEBUG::2013-12-12 12:58:15,636::caps::363::root::(_getKeyPackages) rpm package gluster-swift-account not found >Thread-13::DEBUG::2013-12-12 12:58:15,636::caps::363::root::(_getKeyPackages) rpm package gluster-swift-proxy not found >Thread-13::DEBUG::2013-12-12 12:58:15,636::caps::363::root::(_getKeyPackages) rpm package gluster-swift-doc not found >Thread-13::DEBUG::2013-12-12 12:58:15,636::caps::363::root::(_getKeyPackages) rpm package glusterfs-server not found >Thread-13::DEBUG::2013-12-12 12:58:15,637::caps::363::root::(_getKeyPackages) rpm package gluster-swift-container not found >Thread-13::DEBUG::2013-12-12 12:58:15,637::caps::363::root::(_getKeyPackages) rpm package glusterfs-geo-replication not found >Thread-13::DEBUG::2013-12-12 12:58:15,641::BindingXMLRPC::991::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.28.1.el6.x86_64', 'buildtime': 1384533955.0, 'version': '2.6.32'}, 'vdsm': {'release': '23.1.el6rhs', 'buildtime': 1386773756L, 'version': '4.13.0'}, 'spice-server': {'release': '12.el6_4.5', 'buildtime': 1381834662L, 'version': '0.12.0'}, 'libvirt': {'release': '18.el6_4.13', 'buildtime': 1379320058L, 'version': '0.10.2'}}, 'cpuModel': 'QEMU Virtual CPU version 1.4.2', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.14.16.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.14.16.254', 'ports': ['eth0']}}, 'uuid': '7B904C94-94EE-7B49-40B3-BD3C28FBB749', 'lastClientIface': '', 'nics': {'eth0': {'netmask': '', 'addr': '', 'hwaddr': '52:54:00:b7:60:bc', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': '52:54:00:b7:60:bc', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 100, 'mtu': '1500'}}, 'software_revision': '23.1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': 'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,lm,up,rep_good,unfair_spinlock,pni,cx16,popcnt,hypervisor,lahf_lm', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '4062', 'cpuSpeed': '2393.998', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '1', 'kvmEnabled': 'false', 'rhsVersion': {'release': '1.el6rhs', 'version': '2.1.2.0', 'name': 'RHS'}, 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '1', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '0.0.0.0'}} >Thread-14::DEBUG::2013-12-12 12:58:15,656::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getHardwareInfo with () {} >Thread-14::DEBUG::2013-12-12 12:58:15,687::BindingXMLRPC::991::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'Bochs', 'systemSerialNumber': 'Not Specified', 'systemFamily': 'Not Specified', 'systemVersion': 'Not Specified', 'systemUUID': '7b904c94-94ee-7b49-40b3-bd3c28fbb749', 'systemManufacturer': 'Bochs'}} >Thread-15::DEBUG::2013-12-12 12:58:15,709::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-15::DEBUG::2013-12-12 12:58:16,095::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-17::DEBUG::2013-12-12 12:58:16,116::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostUUIDGet with () {} flowID [2bb64471] >Thread-17::DEBUG::2013-12-12 12:58:16,314::BindingXMLRPC::991::vds::(wrapper) return hostUUIDGet with {'status': {'message': 'Done', 'code': 0}, 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'} >storageRefresh::DEBUG::2013-12-12 12:58:18,126::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >storageRefresh::DEBUG::2013-12-12 12:58:18,160::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 12:58:18,160::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 12:58:18,161::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 12:58:18,161::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 12:58:18,161::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 12:58:18,161::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 12:58:18,162::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 12:58:18,162::misc::819::SamplingMethod::(__call__) Returning last result >storageRefresh::WARNING::2013-12-12 12:58:18,162::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >KsmMonitor::DEBUG::2013-12-12 12:58:20,086::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2013-12-12 12:58:20,086::utils::489::root::(execCmd) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2013-12-12 12:58:20,136::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-20::DEBUG::2013-12-12 12:58:25,712::task::579::TaskManager.Task::(_updateState) Task=`390ecf3d-d8ee-453c-8670-bbcebcbbb635`::moving from state init -> state preparing >Thread-20::INFO::2013-12-12 12:58:25,712::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-20::INFO::2013-12-12 12:58:25,712::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-20::DEBUG::2013-12-12 12:58:25,712::task::1168::TaskManager.Task::(prepare) Task=`390ecf3d-d8ee-453c-8670-bbcebcbbb635`::finished: {} >Thread-20::DEBUG::2013-12-12 12:58:25,713::task::579::TaskManager.Task::(_updateState) Task=`390ecf3d-d8ee-453c-8670-bbcebcbbb635`::moving from state preparing -> state finished >Thread-20::DEBUG::2013-12-12 12:58:25,713::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20::DEBUG::2013-12-12 12:58:25,713::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20::DEBUG::2013-12-12 12:58:25,713::task::974::TaskManager.Task::(_decref) Task=`390ecf3d-d8ee-453c-8670-bbcebcbbb635`::ref 0 aborting False >Thread-23::DEBUG::2013-12-12 12:58:29,762::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-23::DEBUG::2013-12-12 12:58:30,090::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-24::DEBUG::2013-12-12 12:58:30,101::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-24::DEBUG::2013-12-12 12:58:30,267::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'user.cifs': 'enable', 'nfs.disable': 'off', 'auth.allow': '*'}}}} >Thread-27::DEBUG::2013-12-12 12:58:35,287::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-27::DEBUG::2013-12-12 12:58:35,615::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-28::DEBUG::2013-12-12 12:58:35,628::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-28::DEBUG::2013-12-12 12:58:35,795::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'user.cifs': 'enable', 'nfs.disable': 'off', 'auth.allow': '*'}}}} >Thread-30::DEBUG::2013-12-12 12:58:40,877::task::579::TaskManager.Task::(_updateState) Task=`fbeac8a0-5650-4d81-b1a0-2ffbc06433ab`::moving from state init -> state preparing >Thread-30::INFO::2013-12-12 12:58:40,877::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-30::INFO::2013-12-12 12:58:40,878::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-30::DEBUG::2013-12-12 12:58:40,878::task::1168::TaskManager.Task::(prepare) Task=`fbeac8a0-5650-4d81-b1a0-2ffbc06433ab`::finished: {} >Thread-30::DEBUG::2013-12-12 12:58:40,878::task::579::TaskManager.Task::(_updateState) Task=`fbeac8a0-5650-4d81-b1a0-2ffbc06433ab`::moving from state preparing -> state finished >Thread-30::DEBUG::2013-12-12 12:58:40,878::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-30::DEBUG::2013-12-12 12:58:40,878::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-30::DEBUG::2013-12-12 12:58:40,878::task::974::TaskManager.Task::(_decref) Task=`fbeac8a0-5650-4d81-b1a0-2ffbc06433ab`::ref 0 aborting False >Thread-33::DEBUG::2013-12-12 12:58:46,341::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-33::DEBUG::2013-12-12 12:58:46,671::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-34::DEBUG::2013-12-12 12:58:46,679::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-34::DEBUG::2013-12-12 12:58:46,844::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'user.cifs': 'enable', 'nfs.disable': 'off', 'auth.allow': '*'}}}} >Thread-37::DEBUG::2013-12-12 12:58:51,878::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-37::DEBUG::2013-12-12 12:58:52,203::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-38::DEBUG::2013-12-12 12:58:52,211::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-38::DEBUG::2013-12-12 12:58:52,377::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'user.cifs': 'enable', 'nfs.disable': 'off', 'auth.allow': '*'}}}} >Thread-40::DEBUG::2013-12-12 12:58:55,985::task::579::TaskManager.Task::(_updateState) Task=`f592a079-b25e-45d4-b08b-894fd967bc24`::moving from state init -> state preparing >Thread-40::INFO::2013-12-12 12:58:55,985::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-40::INFO::2013-12-12 12:58:55,985::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-40::DEBUG::2013-12-12 12:58:55,985::task::1168::TaskManager.Task::(prepare) Task=`f592a079-b25e-45d4-b08b-894fd967bc24`::finished: {} >Thread-40::DEBUG::2013-12-12 12:58:55,985::task::579::TaskManager.Task::(_updateState) Task=`f592a079-b25e-45d4-b08b-894fd967bc24`::moving from state preparing -> state finished >Thread-40::DEBUG::2013-12-12 12:58:55,985::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-40::DEBUG::2013-12-12 12:58:55,986::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-40::DEBUG::2013-12-12 12:58:55,986::task::974::TaskManager.Task::(_decref) Task=`f592a079-b25e-45d4-b08b-894fd967bc24`::ref 0 aborting False >Thread-46::DEBUG::2013-12-12 12:59:11,085::task::579::TaskManager.Task::(_updateState) Task=`fdc2ef5a-7024-4a28-b20b-d9a120a6a94d`::moving from state init -> state preparing >Thread-46::INFO::2013-12-12 12:59:11,085::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-46::INFO::2013-12-12 12:59:11,085::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-46::DEBUG::2013-12-12 12:59:11,085::task::1168::TaskManager.Task::(prepare) Task=`fdc2ef5a-7024-4a28-b20b-d9a120a6a94d`::finished: {} >Thread-46::DEBUG::2013-12-12 12:59:11,085::task::579::TaskManager.Task::(_updateState) Task=`fdc2ef5a-7024-4a28-b20b-d9a120a6a94d`::moving from state preparing -> state finished >Thread-46::DEBUG::2013-12-12 12:59:11,086::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-46::DEBUG::2013-12-12 12:59:11,086::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-46::DEBUG::2013-12-12 12:59:11,086::task::974::TaskManager.Task::(_decref) Task=`fdc2ef5a-7024-4a28-b20b-d9a120a6a94d`::ref 0 aborting False >Thread-52::DEBUG::2013-12-12 12:59:26,185::task::579::TaskManager.Task::(_updateState) Task=`623d6029-352b-420f-ab89-bd9bed3b3c8c`::moving from state init -> state preparing >Thread-52::INFO::2013-12-12 12:59:26,185::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-52::INFO::2013-12-12 12:59:26,186::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-52::DEBUG::2013-12-12 12:59:26,186::task::1168::TaskManager.Task::(prepare) Task=`623d6029-352b-420f-ab89-bd9bed3b3c8c`::finished: {} >Thread-52::DEBUG::2013-12-12 12:59:26,186::task::579::TaskManager.Task::(_updateState) Task=`623d6029-352b-420f-ab89-bd9bed3b3c8c`::moving from state preparing -> state finished >Thread-52::DEBUG::2013-12-12 12:59:26,186::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-52::DEBUG::2013-12-12 12:59:26,186::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-52::DEBUG::2013-12-12 12:59:26,186::task::974::TaskManager.Task::(_decref) Task=`623d6029-352b-420f-ab89-bd9bed3b3c8c`::ref 0 aborting False >Thread-55::DEBUG::2013-12-12 12:59:30,875::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} flowID [2233cd57] >Thread-55::DEBUG::2013-12-12 12:59:31,200::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-56::DEBUG::2013-12-12 12:59:31,208::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} flowID [2233cd57] >Thread-56::DEBUG::2013-12-12 12:59:31,373::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'user.cifs': 'enable', 'nfs.disable': 'off', 'auth.allow': '*'}}}} >Thread-59::DEBUG::2013-12-12 12:59:36,395::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-59::DEBUG::2013-12-12 12:59:36,726::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-60::DEBUG::2013-12-12 12:59:36,735::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-60::DEBUG::2013-12-12 12:59:36,908::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'user.cifs': 'enable', 'nfs.disable': 'off', 'auth.allow': '*'}}}} >Thread-62::DEBUG::2013-12-12 12:59:41,278::task::579::TaskManager.Task::(_updateState) Task=`6e2e9f6e-387e-4837-9d34-c57e909dc794`::moving from state init -> state preparing >Thread-62::INFO::2013-12-12 12:59:41,279::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-62::INFO::2013-12-12 12:59:41,279::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-62::DEBUG::2013-12-12 12:59:41,279::task::1168::TaskManager.Task::(prepare) Task=`6e2e9f6e-387e-4837-9d34-c57e909dc794`::finished: {} >Thread-62::DEBUG::2013-12-12 12:59:41,279::task::579::TaskManager.Task::(_updateState) Task=`6e2e9f6e-387e-4837-9d34-c57e909dc794`::moving from state preparing -> state finished >Thread-62::DEBUG::2013-12-12 12:59:41,279::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-62::DEBUG::2013-12-12 12:59:41,279::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-62::DEBUG::2013-12-12 12:59:41,279::task::974::TaskManager.Task::(_decref) Task=`6e2e9f6e-387e-4837-9d34-c57e909dc794`::ref 0 aborting False >Thread-68::DEBUG::2013-12-12 12:59:56,383::task::579::TaskManager.Task::(_updateState) Task=`ae36f8db-d3e8-41ed-b6ab-b79bb5361e17`::moving from state init -> state preparing >Thread-68::INFO::2013-12-12 12:59:56,383::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-68::INFO::2013-12-12 12:59:56,383::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-68::DEBUG::2013-12-12 12:59:56,383::task::1168::TaskManager.Task::(prepare) Task=`ae36f8db-d3e8-41ed-b6ab-b79bb5361e17`::finished: {} >Thread-68::DEBUG::2013-12-12 12:59:56,383::task::579::TaskManager.Task::(_updateState) Task=`ae36f8db-d3e8-41ed-b6ab-b79bb5361e17`::moving from state preparing -> state finished >Thread-68::DEBUG::2013-12-12 12:59:56,383::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-68::DEBUG::2013-12-12 12:59:56,384::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-68::DEBUG::2013-12-12 12:59:56,384::task::974::TaskManager.Task::(_decref) Task=`ae36f8db-d3e8-41ed-b6ab-b79bb5361e17`::ref 0 aborting False >Thread-72::DEBUG::2013-12-12 13:00:04,036::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-72::DEBUG::2013-12-12 13:00:04,364::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-73::DEBUG::2013-12-12 13:00:04,373::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-73::DEBUG::2013-12-12 13:00:04,538::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'user.cifs': 'enable', 'nfs.disable': 'off', 'auth.allow': '*'}}}} >Thread-76::DEBUG::2013-12-12 13:00:09,561::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-76::DEBUG::2013-12-12 13:00:09,892::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-77::DEBUG::2013-12-12 13:00:09,899::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-77::DEBUG::2013-12-12 13:00:10,067::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '91b69da7-27be-4b5f-a00e-6af59f660a80', 'bricks': ['latest-a:/bricks/zzzz', 'latest-b:/bricks/zzzzz'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '2', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {}}, 'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'user.cifs': 'enable', 'nfs.disable': 'off', 'auth.allow': '*'}}}} >Thread-78::DEBUG::2013-12-12 13:00:11,475::task::579::TaskManager.Task::(_updateState) Task=`4db53dbd-e443-477c-8fef-f559feff0622`::moving from state init -> state preparing >Thread-78::INFO::2013-12-12 13:00:11,475::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-78::INFO::2013-12-12 13:00:11,475::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-78::DEBUG::2013-12-12 13:00:11,475::task::1168::TaskManager.Task::(prepare) Task=`4db53dbd-e443-477c-8fef-f559feff0622`::finished: {} >Thread-78::DEBUG::2013-12-12 13:00:11,475::task::579::TaskManager.Task::(_updateState) Task=`4db53dbd-e443-477c-8fef-f559feff0622`::moving from state preparing -> state finished >Thread-78::DEBUG::2013-12-12 13:00:11,476::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-78::DEBUG::2013-12-12 13:00:11,476::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-78::DEBUG::2013-12-12 13:00:11,476::task::974::TaskManager.Task::(_decref) Task=`4db53dbd-e443-477c-8fef-f559feff0622`::ref 0 aborting False >Thread-81::DEBUG::2013-12-12 13:00:15,156::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-81::DEBUG::2013-12-12 13:00:15,614::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-82::DEBUG::2013-12-12 13:00:15,622::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-82::DEBUG::2013-12-12 13:00:15,831::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '91b69da7-27be-4b5f-a00e-6af59f660a80', 'bricks': ['latest-a:/bricks/zzzz', 'latest-b:/bricks/zzzzz'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '2', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}, 'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'user.cifs': 'enable', 'nfs.disable': 'off', 'auth.allow': '*'}}}} >Thread-85::DEBUG::2013-12-12 13:00:20,890::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-85::DEBUG::2013-12-12 13:00:21,228::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-86::DEBUG::2013-12-12 13:00:21,236::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-86::DEBUG::2013-12-12 13:00:21,405::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '91b69da7-27be-4b5f-a00e-6af59f660a80', 'bricks': ['latest-a:/bricks/zzzz', 'latest-b:/bricks/zzzzz'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '2', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}, 'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'user.cifs': 'enable', 'nfs.disable': 'off', 'auth.allow': '*'}}}} >Thread-88::DEBUG::2013-12-12 13:00:26,428::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-89::DEBUG::2013-12-12 13:00:26,685::task::579::TaskManager.Task::(_updateState) Task=`913c770d-e733-42f3-9f82-5442ca2bb0fa`::moving from state init -> state preparing >Thread-89::INFO::2013-12-12 13:00:26,686::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-89::INFO::2013-12-12 13:00:26,686::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-89::DEBUG::2013-12-12 13:00:26,686::task::1168::TaskManager.Task::(prepare) Task=`913c770d-e733-42f3-9f82-5442ca2bb0fa`::finished: {} >Thread-89::DEBUG::2013-12-12 13:00:26,686::task::579::TaskManager.Task::(_updateState) Task=`913c770d-e733-42f3-9f82-5442ca2bb0fa`::moving from state preparing -> state finished >Thread-89::DEBUG::2013-12-12 13:00:26,686::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-89::DEBUG::2013-12-12 13:00:26,686::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-89::DEBUG::2013-12-12 13:00:26,687::task::974::TaskManager.Task::(_decref) Task=`913c770d-e733-42f3-9f82-5442ca2bb0fa`::ref 0 aborting False >Thread-88::DEBUG::2013-12-12 13:00:26,767::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-91::DEBUG::2013-12-12 13:00:26,775::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-91::DEBUG::2013-12-12 13:00:26,940::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '91b69da7-27be-4b5f-a00e-6af59f660a80', 'bricks': ['latest-a:/bricks/zzzz', 'latest-b:/bricks/zzzzz'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '2', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}, 'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'user.cifs': 'enable', 'nfs.disable': 'off', 'auth.allow': '*'}}}} >Thread-93::DEBUG::2013-12-12 13:00:31,963::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-93::DEBUG::2013-12-12 13:00:32,294::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-94::DEBUG::2013-12-12 13:00:32,302::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-94::DEBUG::2013-12-12 13:00:32,471::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '91b69da7-27be-4b5f-a00e-6af59f660a80', 'bricks': ['latest-a:/bricks/zzzz', 'latest-b:/bricks/zzzzz'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '2', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}, 'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'user.cifs': 'enable', 'nfs.disable': 'off', 'auth.allow': '*'}}}} >Thread-97::DEBUG::2013-12-12 13:00:37,495::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-97::DEBUG::2013-12-12 13:00:37,826::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-98::DEBUG::2013-12-12 13:00:37,834::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-98::DEBUG::2013-12-12 13:00:38,005::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '91b69da7-27be-4b5f-a00e-6af59f660a80', 'bricks': ['latest-a:/bricks/zzzz', 'latest-b:/bricks/zzzzz'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '2', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}, 'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'user.cifs': 'enable', 'nfs.disable': 'off', 'auth.allow': '*'}}}} >Thread-100::DEBUG::2013-12-12 13:00:38,930::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeStop with ('foo', False) {} flowID [9d512e3] >Thread-101::DEBUG::2013-12-12 13:00:41,781::task::579::TaskManager.Task::(_updateState) Task=`652424f1-e9cf-4396-bc79-fe0ba9c98b53`::moving from state init -> state preparing >Thread-101::INFO::2013-12-12 13:00:41,782::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-101::INFO::2013-12-12 13:00:41,782::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-101::DEBUG::2013-12-12 13:00:41,782::task::1168::TaskManager.Task::(prepare) Task=`652424f1-e9cf-4396-bc79-fe0ba9c98b53`::finished: {} >Thread-101::DEBUG::2013-12-12 13:00:41,782::task::579::TaskManager.Task::(_updateState) Task=`652424f1-e9cf-4396-bc79-fe0ba9c98b53`::moving from state preparing -> state finished >Thread-101::DEBUG::2013-12-12 13:00:41,782::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-101::DEBUG::2013-12-12 13:00:41,783::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-101::DEBUG::2013-12-12 13:00:41,783::task::974::TaskManager.Task::(_decref) Task=`652424f1-e9cf-4396-bc79-fe0ba9c98b53`::ref 0 aborting False >Thread-100::DEBUG::2013-12-12 13:00:42,823::BindingXMLRPC::991::vds::(wrapper) return volumeStop with {'status': {'message': 'Done', 'code': 0}} >Thread-107::DEBUG::2013-12-12 13:00:56,881::task::579::TaskManager.Task::(_updateState) Task=`079daa64-ebdc-4691-a0a7-6e146791b570`::moving from state init -> state preparing >Thread-107::INFO::2013-12-12 13:00:56,882::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-107::INFO::2013-12-12 13:00:56,882::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-107::DEBUG::2013-12-12 13:00:56,882::task::1168::TaskManager.Task::(prepare) Task=`079daa64-ebdc-4691-a0a7-6e146791b570`::finished: {} >Thread-107::DEBUG::2013-12-12 13:00:56,882::task::579::TaskManager.Task::(_updateState) Task=`079daa64-ebdc-4691-a0a7-6e146791b570`::moving from state preparing -> state finished >Thread-107::DEBUG::2013-12-12 13:00:56,882::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-107::DEBUG::2013-12-12 13:00:56,882::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-107::DEBUG::2013-12-12 13:00:56,883::task::974::TaskManager.Task::(_decref) Task=`079daa64-ebdc-4691-a0a7-6e146791b570`::ref 0 aborting False >Thread-109::DEBUG::2013-12-12 13:00:59,638::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-109::DEBUG::2013-12-12 13:00:59,968::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-111::DEBUG::2013-12-12 13:00:59,976::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-111::DEBUG::2013-12-12 13:01:00,149::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '91b69da7-27be-4b5f-a00e-6af59f660a80', 'bricks': ['latest-a:/bricks/zzzz', 'latest-b:/bricks/zzzzz'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '2', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {}}, 'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'user.cifs': 'enable', 'nfs.disable': 'off', 'auth.allow': '*'}}}} >Thread-112::DEBUG::2013-12-12 13:01:01,077::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeDelete with ('foo',) {} flowID [345f0d63] >Thread-112::DEBUG::2013-12-12 13:01:01,253::BindingXMLRPC::991::vds::(wrapper) return volumeDelete with {'status': {'message': 'Done', 'code': 0}} >Thread-114::DEBUG::2013-12-12 13:01:05,178::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-114::DEBUG::2013-12-12 13:01:05,507::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-115::DEBUG::2013-12-12 13:01:05,519::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-115::DEBUG::2013-12-12 13:01:05,683::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'user.cifs': 'enable', 'nfs.disable': 'off', 'auth.allow': '*'}}}} >Thread-117::DEBUG::2013-12-12 13:01:08,543::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeStop with ('boom', False) {} flowID [6e8924af] >Thread-119::DEBUG::2013-12-12 13:01:11,972::task::579::TaskManager.Task::(_updateState) Task=`70c6666f-00db-4910-b102-ddc6ca2a0968`::moving from state init -> state preparing >Thread-119::INFO::2013-12-12 13:01:11,972::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-119::INFO::2013-12-12 13:01:11,972::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-119::DEBUG::2013-12-12 13:01:11,973::task::1168::TaskManager.Task::(prepare) Task=`70c6666f-00db-4910-b102-ddc6ca2a0968`::finished: {} >Thread-119::DEBUG::2013-12-12 13:01:11,973::task::579::TaskManager.Task::(_updateState) Task=`70c6666f-00db-4910-b102-ddc6ca2a0968`::moving from state preparing -> state finished >Thread-119::DEBUG::2013-12-12 13:01:11,973::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-119::DEBUG::2013-12-12 13:01:11,973::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-119::DEBUG::2013-12-12 13:01:11,973::task::974::TaskManager.Task::(_decref) Task=`70c6666f-00db-4910-b102-ddc6ca2a0968`::ref 0 aborting False >Thread-117::DEBUG::2013-12-12 13:01:14,682::BindingXMLRPC::991::vds::(wrapper) return volumeStop with {'status': {'message': 'Done', 'code': 0}} >Thread-123::DEBUG::2013-12-12 13:01:20,312::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-123::DEBUG::2013-12-12 13:01:20,645::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-124::DEBUG::2013-12-12 13:01:20,657::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-124::DEBUG::2013-12-12 13:01:20,828::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'boom': {'transportType': ['TCP'], 'uuid': 'a28a613a-efe8-4b17-b969-297dd32f9f28', 'bricks': ['latest-a:/bricks/adsfasfas', 'latest-a:/bricks/adsfasfass', 'latest-a:/bricks/adsfasfassz', 'latest-b:/bricks/adsfasfas', 'latest-b:/bricks/adsf', 'latest-b:/bricks/adsfasfasds'], 'volumeName': 'boom', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'user.cifs': 'enable', 'nfs.disable': 'off', 'auth.allow': '*'}}}} >Thread-127::DEBUG::2013-12-12 13:01:28,133::task::579::TaskManager.Task::(_updateState) Task=`e3ab43eb-c16a-453e-b91a-18e1c28aedc7`::moving from state init -> state preparing >Thread-127::INFO::2013-12-12 13:01:28,133::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-127::INFO::2013-12-12 13:01:28,133::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-127::DEBUG::2013-12-12 13:01:28,133::task::1168::TaskManager.Task::(prepare) Task=`e3ab43eb-c16a-453e-b91a-18e1c28aedc7`::finished: {} >Thread-127::DEBUG::2013-12-12 13:01:28,134::task::579::TaskManager.Task::(_updateState) Task=`e3ab43eb-c16a-453e-b91a-18e1c28aedc7`::moving from state preparing -> state finished >Thread-127::DEBUG::2013-12-12 13:01:28,134::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-127::DEBUG::2013-12-12 13:01:28,134::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-127::DEBUG::2013-12-12 13:01:28,134::task::974::TaskManager.Task::(_decref) Task=`e3ab43eb-c16a-453e-b91a-18e1c28aedc7`::ref 0 aborting False >Thread-129::DEBUG::2013-12-12 13:01:28,821::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeDelete with ('boom',) {} flowID [71ff4bcc] >Thread-129::DEBUG::2013-12-12 13:01:28,990::BindingXMLRPC::991::vds::(wrapper) return volumeDelete with {'status': {'message': 'Done', 'code': 0}} >Thread-133::DEBUG::2013-12-12 13:01:37,906::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-133::DEBUG::2013-12-12 13:01:38,233::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-134::DEBUG::2013-12-12 13:01:38,240::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-134::DEBUG::2013-12-12 13:01:38,406::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-136::DEBUG::2013-12-12 13:01:43,233::task::579::TaskManager.Task::(_updateState) Task=`32daa806-f863-45d6-8266-7b91d1095c67`::moving from state init -> state preparing >Thread-136::INFO::2013-12-12 13:01:43,233::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136::INFO::2013-12-12 13:01:43,233::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-136::DEBUG::2013-12-12 13:01:43,233::task::1168::TaskManager.Task::(prepare) Task=`32daa806-f863-45d6-8266-7b91d1095c67`::finished: {} >Thread-136::DEBUG::2013-12-12 13:01:43,233::task::579::TaskManager.Task::(_updateState) Task=`32daa806-f863-45d6-8266-7b91d1095c67`::moving from state preparing -> state finished >Thread-136::DEBUG::2013-12-12 13:01:43,234::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136::DEBUG::2013-12-12 13:01:43,234::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136::DEBUG::2013-12-12 13:01:43,234::task::974::TaskManager.Task::(_decref) Task=`32daa806-f863-45d6-8266-7b91d1095c67`::ref 0 aborting False >Thread-138::DEBUG::2013-12-12 13:01:43,417::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-138::DEBUG::2013-12-12 13:01:43,744::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-139::DEBUG::2013-12-12 13:01:43,754::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-139::DEBUG::2013-12-12 13:01:43,917::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-144::DEBUG::2013-12-12 13:01:58,318::task::579::TaskManager.Task::(_updateState) Task=`7d34f8f4-6249-4a4b-bb9b-c038d0a98c37`::moving from state init -> state preparing >Thread-144::INFO::2013-12-12 13:01:58,318::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-144::INFO::2013-12-12 13:01:58,319::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-144::DEBUG::2013-12-12 13:01:58,319::task::1168::TaskManager.Task::(prepare) Task=`7d34f8f4-6249-4a4b-bb9b-c038d0a98c37`::finished: {} >Thread-144::DEBUG::2013-12-12 13:01:58,319::task::579::TaskManager.Task::(_updateState) Task=`7d34f8f4-6249-4a4b-bb9b-c038d0a98c37`::moving from state preparing -> state finished >Thread-144::DEBUG::2013-12-12 13:01:58,319::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-144::DEBUG::2013-12-12 13:01:58,319::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-144::DEBUG::2013-12-12 13:01:58,319::task::974::TaskManager.Task::(_decref) Task=`7d34f8f4-6249-4a4b-bb9b-c038d0a98c37`::ref 0 aborting False >Thread-146::DEBUG::2013-12-12 13:01:59,968::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-146::DEBUG::2013-12-12 13:02:00,294::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-147::DEBUG::2013-12-12 13:02:00,302::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-147::DEBUG::2013-12-12 13:02:00,467::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-148::DEBUG::2013-12-12 13:02:01,049::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-148::DEBUG::2013-12-12 13:02:01,227::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-153::DEBUG::2013-12-12 13:02:13,425::task::579::TaskManager.Task::(_updateState) Task=`6b9622c6-4bb7-4066-a0cc-36182479ba81`::moving from state init -> state preparing >Thread-153::INFO::2013-12-12 13:02:13,425::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-153::INFO::2013-12-12 13:02:13,425::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-153::DEBUG::2013-12-12 13:02:13,426::task::1168::TaskManager.Task::(prepare) Task=`6b9622c6-4bb7-4066-a0cc-36182479ba81`::finished: {} >Thread-153::DEBUG::2013-12-12 13:02:13,426::task::579::TaskManager.Task::(_updateState) Task=`6b9622c6-4bb7-4066-a0cc-36182479ba81`::moving from state preparing -> state finished >Thread-153::DEBUG::2013-12-12 13:02:13,426::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-153::DEBUG::2013-12-12 13:02:13,426::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-153::DEBUG::2013-12-12 13:02:13,426::task::974::TaskManager.Task::(_decref) Task=`6b9622c6-4bb7-4066-a0cc-36182479ba81`::ref 0 aborting False >Thread-157::DEBUG::2013-12-12 13:02:22,035::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-157::DEBUG::2013-12-12 13:02:22,365::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-158::DEBUG::2013-12-12 13:02:22,373::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-158::DEBUG::2013-12-12 13:02:22,542::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-161::DEBUG::2013-12-12 13:02:28,568::task::579::TaskManager.Task::(_updateState) Task=`dbdc483b-e2df-4abd-b465-513aaa036366`::moving from state init -> state preparing >Thread-161::INFO::2013-12-12 13:02:28,568::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-161::INFO::2013-12-12 13:02:28,568::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-161::DEBUG::2013-12-12 13:02:28,568::task::1168::TaskManager.Task::(prepare) Task=`dbdc483b-e2df-4abd-b465-513aaa036366`::finished: {} >Thread-161::DEBUG::2013-12-12 13:02:28,568::task::579::TaskManager.Task::(_updateState) Task=`dbdc483b-e2df-4abd-b465-513aaa036366`::moving from state preparing -> state finished >Thread-161::DEBUG::2013-12-12 13:02:28,568::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-161::DEBUG::2013-12-12 13:02:28,569::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-161::DEBUG::2013-12-12 13:02:28,569::task::974::TaskManager.Task::(_decref) Task=`dbdc483b-e2df-4abd-b465-513aaa036366`::ref 0 aborting False >Thread-165::DEBUG::2013-12-12 13:02:37,002::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeSet with ('foo', 'nfs.disable', 'off') {} flowID [731f9a34] >Thread-165::DEBUG::2013-12-12 13:02:41,118::BindingXMLRPC::991::vds::(wrapper) return volumeSet with {'status': {'message': 'Done', 'code': 0}} >Thread-168::DEBUG::2013-12-12 13:02:41,207::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeSet with ('foo', 'user.cifs', 'enable') {} flowID [566aacde] >Thread-169::DEBUG::2013-12-12 13:02:43,674::task::579::TaskManager.Task::(_updateState) Task=`5b29318d-cad6-4897-8333-865615f2bcca`::moving from state init -> state preparing >Thread-169::INFO::2013-12-12 13:02:43,675::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-169::INFO::2013-12-12 13:02:43,675::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-169::DEBUG::2013-12-12 13:02:43,675::task::1168::TaskManager.Task::(prepare) Task=`5b29318d-cad6-4897-8333-865615f2bcca`::finished: {} >Thread-169::DEBUG::2013-12-12 13:02:43,675::task::579::TaskManager.Task::(_updateState) Task=`5b29318d-cad6-4897-8333-865615f2bcca`::moving from state preparing -> state finished >Thread-169::DEBUG::2013-12-12 13:02:43,675::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-169::DEBUG::2013-12-12 13:02:43,676::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-169::DEBUG::2013-12-12 13:02:43,676::task::974::TaskManager.Task::(_decref) Task=`5b29318d-cad6-4897-8333-865615f2bcca`::ref 0 aborting False >Thread-168::DEBUG::2013-12-12 13:02:45,362::BindingXMLRPC::991::vds::(wrapper) return volumeSet with {'status': {'message': 'Done', 'code': 0}} >Thread-171::DEBUG::2013-12-12 13:02:45,447::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeSet with ('foo', 'auth.allow', '*') {} flowID [d362a4e] >Thread-171::DEBUG::2013-12-12 13:02:50,024::BindingXMLRPC::991::vds::(wrapper) return volumeSet with {'status': {'message': 'Done', 'code': 0}} >Thread-174::DEBUG::2013-12-12 13:02:50,058::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-174::DEBUG::2013-12-12 13:02:50,387::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-175::DEBUG::2013-12-12 13:02:50,395::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-175::DEBUG::2013-12-12 13:02:50,565::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-178::DEBUG::2013-12-12 13:02:58,774::task::579::TaskManager.Task::(_updateState) Task=`470f3f14-191d-4024-807a-62d967e148c0`::moving from state init -> state preparing >Thread-178::INFO::2013-12-12 13:02:58,774::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-178::INFO::2013-12-12 13:02:58,774::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-178::DEBUG::2013-12-12 13:02:58,774::task::1168::TaskManager.Task::(prepare) Task=`470f3f14-191d-4024-807a-62d967e148c0`::finished: {} >Thread-178::DEBUG::2013-12-12 13:02:58,774::task::579::TaskManager.Task::(_updateState) Task=`470f3f14-191d-4024-807a-62d967e148c0`::moving from state preparing -> state finished >Thread-178::DEBUG::2013-12-12 13:02:58,774::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-178::DEBUG::2013-12-12 13:02:58,775::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-178::DEBUG::2013-12-12 13:02:58,775::task::974::TaskManager.Task::(_decref) Task=`470f3f14-191d-4024-807a-62d967e148c0`::ref 0 aborting False >Thread-180::DEBUG::2013-12-12 13:02:59,915::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeStart with ('foo', False) {} flowID [3e0a4e43] >Thread-180::ERROR::2013-12-12 13:03:00,088::BindingXMLRPC::1000::vds::(wrapper) vdsm exception occured >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 989, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 53, in wrapper > rv = func(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 89, in volumeStart > self.svdsmProxy.glusterVolumeStart(volumeName, force) > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in glusterVolumeStart > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >GlusterVolumeStartFailedException: Volume start failed >error: volume start: foo: failed: Volume foo already started >return code: 1 >Thread-181::DEBUG::2013-12-12 13:03:01,236::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-181::DEBUG::2013-12-12 13:03:01,416::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-183::DEBUG::2013-12-12 13:03:04,882::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-183::DEBUG::2013-12-12 13:03:05,212::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-185::DEBUG::2013-12-12 13:03:05,219::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-185::DEBUG::2013-12-12 13:03:05,384::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-188::DEBUG::2013-12-12 13:03:13,948::task::579::TaskManager.Task::(_updateState) Task=`739eb9a6-9e0a-497a-8bad-2a0c40ed9958`::moving from state init -> state preparing >Thread-188::INFO::2013-12-12 13:03:13,948::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-188::INFO::2013-12-12 13:03:13,948::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-188::DEBUG::2013-12-12 13:03:13,949::task::1168::TaskManager.Task::(prepare) Task=`739eb9a6-9e0a-497a-8bad-2a0c40ed9958`::finished: {} >Thread-188::DEBUG::2013-12-12 13:03:13,949::task::579::TaskManager.Task::(_updateState) Task=`739eb9a6-9e0a-497a-8bad-2a0c40ed9958`::moving from state preparing -> state finished >Thread-188::DEBUG::2013-12-12 13:03:13,949::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-188::DEBUG::2013-12-12 13:03:13,949::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-188::DEBUG::2013-12-12 13:03:13,949::task::974::TaskManager.Task::(_decref) Task=`739eb9a6-9e0a-497a-8bad-2a0c40ed9958`::ref 0 aborting False >Thread-194::DEBUG::2013-12-12 13:03:29,145::task::579::TaskManager.Task::(_updateState) Task=`e589eb8d-88e1-45a4-ac4d-74b4a60a622a`::moving from state init -> state preparing >Thread-194::INFO::2013-12-12 13:03:29,145::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-194::INFO::2013-12-12 13:03:29,145::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-194::DEBUG::2013-12-12 13:03:29,146::task::1168::TaskManager.Task::(prepare) Task=`e589eb8d-88e1-45a4-ac4d-74b4a60a622a`::finished: {} >Thread-194::DEBUG::2013-12-12 13:03:29,146::task::579::TaskManager.Task::(_updateState) Task=`e589eb8d-88e1-45a4-ac4d-74b4a60a622a`::moving from state preparing -> state finished >Thread-194::DEBUG::2013-12-12 13:03:29,146::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-194::DEBUG::2013-12-12 13:03:29,146::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-194::DEBUG::2013-12-12 13:03:29,146::task::974::TaskManager.Task::(_decref) Task=`e589eb8d-88e1-45a4-ac4d-74b4a60a622a`::ref 0 aborting False >Thread-200::DEBUG::2013-12-12 13:03:44,229::task::579::TaskManager.Task::(_updateState) Task=`1a798855-aefa-4e5b-aad5-82a3ec134296`::moving from state init -> state preparing >Thread-200::INFO::2013-12-12 13:03:44,229::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-200::INFO::2013-12-12 13:03:44,230::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-200::DEBUG::2013-12-12 13:03:44,230::task::1168::TaskManager.Task::(prepare) Task=`1a798855-aefa-4e5b-aad5-82a3ec134296`::finished: {} >Thread-200::DEBUG::2013-12-12 13:03:44,230::task::579::TaskManager.Task::(_updateState) Task=`1a798855-aefa-4e5b-aad5-82a3ec134296`::moving from state preparing -> state finished >Thread-200::DEBUG::2013-12-12 13:03:44,230::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-200::DEBUG::2013-12-12 13:03:44,230::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-200::DEBUG::2013-12-12 13:03:44,231::task::974::TaskManager.Task::(_decref) Task=`1a798855-aefa-4e5b-aad5-82a3ec134296`::ref 0 aborting False >Thread-203::DEBUG::2013-12-12 13:03:48,729::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-203::DEBUG::2013-12-12 13:03:49,057::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-204::DEBUG::2013-12-12 13:03:49,065::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-204::DEBUG::2013-12-12 13:03:49,232::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '7', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-206::DEBUG::2013-12-12 13:03:50,505::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeBrickAdd with ('foo', ['latest-a:/bricks/asdfdfasdfasdf'], 0, 0, False) {} flowID [1212cb49] >Thread-206::DEBUG::2013-12-12 13:03:59,318::BindingXMLRPC::991::vds::(wrapper) return volumeBrickAdd with {'status': {'message': 'Done', 'code': 0}} >Thread-209::DEBUG::2013-12-12 13:03:59,321::task::579::TaskManager.Task::(_updateState) Task=`e6ca6e2f-4df8-4fda-9850-b2065d44d732`::moving from state init -> state preparing >Thread-209::INFO::2013-12-12 13:03:59,321::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-209::INFO::2013-12-12 13:03:59,321::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-209::DEBUG::2013-12-12 13:03:59,321::task::1168::TaskManager.Task::(prepare) Task=`e6ca6e2f-4df8-4fda-9850-b2065d44d732`::finished: {} >Thread-209::DEBUG::2013-12-12 13:03:59,322::task::579::TaskManager.Task::(_updateState) Task=`e6ca6e2f-4df8-4fda-9850-b2065d44d732`::moving from state preparing -> state finished >Thread-209::DEBUG::2013-12-12 13:03:59,322::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-209::DEBUG::2013-12-12 13:03:59,322::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-209::DEBUG::2013-12-12 13:03:59,322::task::974::TaskManager.Task::(_decref) Task=`e6ca6e2f-4df8-4fda-9850-b2065d44d732`::ref 0 aborting False >Thread-212::DEBUG::2013-12-12 13:04:04,996::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-212::DEBUG::2013-12-12 13:04:05,321::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-213::DEBUG::2013-12-12 13:04:05,328::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-213::DEBUG::2013-12-12 13:04:05,497::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '8', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-216::DEBUG::2013-12-12 13:04:10,516::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-216::DEBUG::2013-12-12 13:04:10,846::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-217::DEBUG::2013-12-12 13:04:10,854::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-217::DEBUG::2013-12-12 13:04:11,020::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '8', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-219::DEBUG::2013-12-12 13:04:14,429::task::579::TaskManager.Task::(_updateState) Task=`4e10eb01-7952-430d-af94-4966f1208fde`::moving from state init -> state preparing >Thread-219::INFO::2013-12-12 13:04:14,429::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-219::INFO::2013-12-12 13:04:14,429::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-219::DEBUG::2013-12-12 13:04:14,429::task::1168::TaskManager.Task::(prepare) Task=`4e10eb01-7952-430d-af94-4966f1208fde`::finished: {} >Thread-219::DEBUG::2013-12-12 13:04:14,430::task::579::TaskManager.Task::(_updateState) Task=`4e10eb01-7952-430d-af94-4966f1208fde`::moving from state preparing -> state finished >Thread-219::DEBUG::2013-12-12 13:04:14,430::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-219::DEBUG::2013-12-12 13:04:14,430::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-219::DEBUG::2013-12-12 13:04:14,430::task::974::TaskManager.Task::(_decref) Task=`4e10eb01-7952-430d-af94-4966f1208fde`::ref 0 aborting False >Thread-225::DEBUG::2013-12-12 13:04:29,529::task::579::TaskManager.Task::(_updateState) Task=`61efa8dc-289f-4b80-96e7-b29fa0fff977`::moving from state init -> state preparing >Thread-225::INFO::2013-12-12 13:04:29,529::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-225::INFO::2013-12-12 13:04:29,529::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-225::DEBUG::2013-12-12 13:04:29,529::task::1168::TaskManager.Task::(prepare) Task=`61efa8dc-289f-4b80-96e7-b29fa0fff977`::finished: {} >Thread-225::DEBUG::2013-12-12 13:04:29,529::task::579::TaskManager.Task::(_updateState) Task=`61efa8dc-289f-4b80-96e7-b29fa0fff977`::moving from state preparing -> state finished >Thread-225::DEBUG::2013-12-12 13:04:29,530::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-225::DEBUG::2013-12-12 13:04:29,530::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-225::DEBUG::2013-12-12 13:04:29,530::task::974::TaskManager.Task::(_decref) Task=`61efa8dc-289f-4b80-96e7-b29fa0fff977`::ref 0 aborting False >Thread-228::DEBUG::2013-12-12 13:04:32,626::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-228::DEBUG::2013-12-12 13:04:32,964::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-229::DEBUG::2013-12-12 13:04:32,972::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-229::DEBUG::2013-12-12 13:04:33,138::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '8', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-231::DEBUG::2013-12-12 13:04:38,158::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-231::DEBUG::2013-12-12 13:04:38,489::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-232::DEBUG::2013-12-12 13:04:38,499::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-232::DEBUG::2013-12-12 13:04:38,672::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '8', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-235::DEBUG::2013-12-12 13:04:43,691::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-235::DEBUG::2013-12-12 13:04:44,021::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-236::DEBUG::2013-12-12 13:04:44,031::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-236::DEBUG::2013-12-12 13:04:44,198::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '8', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-237::DEBUG::2013-12-12 13:04:44,623::task::579::TaskManager.Task::(_updateState) Task=`d1317bb9-7c77-4918-a125-823535cd80d8`::moving from state init -> state preparing >Thread-237::INFO::2013-12-12 13:04:44,623::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-237::INFO::2013-12-12 13:04:44,623::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-237::DEBUG::2013-12-12 13:04:44,623::task::1168::TaskManager.Task::(prepare) Task=`d1317bb9-7c77-4918-a125-823535cd80d8`::finished: {} >Thread-237::DEBUG::2013-12-12 13:04:44,624::task::579::TaskManager.Task::(_updateState) Task=`d1317bb9-7c77-4918-a125-823535cd80d8`::moving from state preparing -> state finished >Thread-237::DEBUG::2013-12-12 13:04:44,624::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-237::DEBUG::2013-12-12 13:04:44,624::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-237::DEBUG::2013-12-12 13:04:44,624::task::974::TaskManager.Task::(_decref) Task=`d1317bb9-7c77-4918-a125-823535cd80d8`::ref 0 aborting False >Thread-242::DEBUG::2013-12-12 13:04:55,949::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeStatus with ('foo', '', '') {} >Thread-242::DEBUG::2013-12-12 13:04:56,124::BindingXMLRPC::991::vds::(wrapper) return volumeStatus with {'volumeStatus': {'bricks': [{'status': 'ONLINE', 'brick': 'latest-a:/bricks/asdf', 'pid': '4651', 'port': '49156', 'hostuuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}, {'status': 'ONLINE', 'brick': 'latest-a:/bricks/asdfdsdf', 'pid': '4662', 'port': '49157', 'hostuuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}, {'status': 'ONLINE', 'brick': 'latest-a:/bricks/asdfssasdfa', 'pid': '4673', 'port': '49158', 'hostuuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/asdf', 'pid': '4312', 'port': '49170', 'hostuuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/asdfsdf', 'pid': '4323', 'port': '49171', 'hostuuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/asdfsdfasdf', 'pid': '4334', 'port': '49172', 'hostuuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/asdfsdfasdfsa', 'pid': '4460', 'port': '49173', 'hostuuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'ONLINE', 'brick': 'latest-a:/bricks/asdfdfasdfasdf', 'pid': '5083', 'port': '49159', 'hostuuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/asdfsdfsadfadsfsaf', 'pid': '4831', 'port': '49174', 'hostuuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}], 'nfs': [{'status': 'OFFLINE', 'hostname': '10.14.16.127', 'pid': '-1', 'port': 'N/A', 'hostuuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'ONLINE', 'hostname': '10.14.16.132', 'pid': '5356', 'port': '2049', 'hostuuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}], 'shd': [], 'name': 'foo'}, 'status': {'message': 'Done', 'code': 0}} >Thread-244::DEBUG::2013-12-12 13:04:58,685::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-244::DEBUG::2013-12-12 13:04:59,016::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-245::DEBUG::2013-12-12 13:04:59,025::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-245::DEBUG::2013-12-12 13:04:59,194::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf', 'latest-b:/bricks/asdfsdfsadfadsfsaf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '9', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-246::DEBUG::2013-12-12 13:04:59,713::task::579::TaskManager.Task::(_updateState) Task=`ca9ee900-47cd-4c5c-b702-3e1df6689bfa`::moving from state init -> state preparing >Thread-246::INFO::2013-12-12 13:04:59,713::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-246::INFO::2013-12-12 13:04:59,713::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-246::DEBUG::2013-12-12 13:04:59,714::task::1168::TaskManager.Task::(prepare) Task=`ca9ee900-47cd-4c5c-b702-3e1df6689bfa`::finished: {} >Thread-246::DEBUG::2013-12-12 13:04:59,714::task::579::TaskManager.Task::(_updateState) Task=`ca9ee900-47cd-4c5c-b702-3e1df6689bfa`::moving from state preparing -> state finished >Thread-246::DEBUG::2013-12-12 13:04:59,714::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-246::DEBUG::2013-12-12 13:04:59,714::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-246::DEBUG::2013-12-12 13:04:59,714::task::974::TaskManager.Task::(_decref) Task=`ca9ee900-47cd-4c5c-b702-3e1df6689bfa`::ref 0 aborting False >Thread-248::DEBUG::2013-12-12 13:05:01,639::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-248::DEBUG::2013-12-12 13:05:01,814::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-253::DEBUG::2013-12-12 13:05:14,801::task::579::TaskManager.Task::(_updateState) Task=`77e21805-9e6d-439f-9a47-df6d7fa7d1aa`::moving from state init -> state preparing >Thread-253::INFO::2013-12-12 13:05:14,801::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-253::INFO::2013-12-12 13:05:14,801::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-253::DEBUG::2013-12-12 13:05:14,802::task::1168::TaskManager.Task::(prepare) Task=`77e21805-9e6d-439f-9a47-df6d7fa7d1aa`::finished: {} >Thread-253::DEBUG::2013-12-12 13:05:14,802::task::579::TaskManager.Task::(_updateState) Task=`77e21805-9e6d-439f-9a47-df6d7fa7d1aa`::moving from state preparing -> state finished >Thread-253::DEBUG::2013-12-12 13:05:14,802::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-253::DEBUG::2013-12-12 13:05:14,802::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-253::DEBUG::2013-12-12 13:05:14,802::task::974::TaskManager.Task::(_decref) Task=`77e21805-9e6d-439f-9a47-df6d7fa7d1aa`::ref 0 aborting False >Thread-255::DEBUG::2013-12-12 13:05:15,270::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-255::DEBUG::2013-12-12 13:05:15,611::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-256::DEBUG::2013-12-12 13:05:15,621::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-256::DEBUG::2013-12-12 13:05:15,791::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf', 'latest-b:/bricks/asdfsdfsadfadsfsaf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '9', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-260::DEBUG::2013-12-12 13:05:26,337::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-260::DEBUG::2013-12-12 13:05:26,669::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-261::DEBUG::2013-12-12 13:05:26,677::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-261::DEBUG::2013-12-12 13:05:26,846::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf', 'latest-b:/bricks/asdfsdfsadfadsfsaf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '9', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-263::DEBUG::2013-12-12 13:05:29,899::task::579::TaskManager.Task::(_updateState) Task=`bb342ec1-3978-4f72-975e-e3178e5e2740`::moving from state init -> state preparing >Thread-263::INFO::2013-12-12 13:05:29,899::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-263::INFO::2013-12-12 13:05:29,899::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-263::DEBUG::2013-12-12 13:05:29,900::task::1168::TaskManager.Task::(prepare) Task=`bb342ec1-3978-4f72-975e-e3178e5e2740`::finished: {} >Thread-263::DEBUG::2013-12-12 13:05:29,900::task::579::TaskManager.Task::(_updateState) Task=`bb342ec1-3978-4f72-975e-e3178e5e2740`::moving from state preparing -> state finished >Thread-263::DEBUG::2013-12-12 13:05:29,900::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-263::DEBUG::2013-12-12 13:05:29,900::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-263::DEBUG::2013-12-12 13:05:29,900::task::974::TaskManager.Task::(_decref) Task=`bb342ec1-3978-4f72-975e-e3178e5e2740`::ref 0 aborting False >Thread-269::DEBUG::2013-12-12 13:05:42,921::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-269::DEBUG::2013-12-12 13:05:43,252::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-270::DEBUG::2013-12-12 13:05:43,259::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-270::DEBUG::2013-12-12 13:05:43,429::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf', 'latest-b:/bricks/asdfsdfsadfadsfsaf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '9', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-271::DEBUG::2013-12-12 13:05:44,984::task::579::TaskManager.Task::(_updateState) Task=`bf14cad8-e9e7-47bc-a151-7ed0f501af9a`::moving from state init -> state preparing >Thread-271::INFO::2013-12-12 13:05:44,984::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-271::INFO::2013-12-12 13:05:44,984::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-271::DEBUG::2013-12-12 13:05:44,984::task::1168::TaskManager.Task::(prepare) Task=`bf14cad8-e9e7-47bc-a151-7ed0f501af9a`::finished: {} >Thread-271::DEBUG::2013-12-12 13:05:44,984::task::579::TaskManager.Task::(_updateState) Task=`bf14cad8-e9e7-47bc-a151-7ed0f501af9a`::moving from state preparing -> state finished >Thread-271::DEBUG::2013-12-12 13:05:44,985::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-271::DEBUG::2013-12-12 13:05:44,985::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-271::DEBUG::2013-12-12 13:05:44,985::task::974::TaskManager.Task::(_decref) Task=`bf14cad8-e9e7-47bc-a151-7ed0f501af9a`::ref 0 aborting False >Thread-275::DEBUG::2013-12-12 13:05:53,975::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-275::DEBUG::2013-12-12 13:05:54,304::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-277::DEBUG::2013-12-12 13:05:54,311::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-277::DEBUG::2013-12-12 13:05:54,478::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf', 'latest-b:/bricks/asdfsdfsadfadsfsaf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '9', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-279::DEBUG::2013-12-12 13:05:59,496::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-279::DEBUG::2013-12-12 13:05:59,827::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-280::DEBUG::2013-12-12 13:05:59,834::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-280::DEBUG::2013-12-12 13:06:00,001::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf', 'latest-b:/bricks/asdfsdfsadfadsfsaf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '9', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-281::DEBUG::2013-12-12 13:06:00,075::task::579::TaskManager.Task::(_updateState) Task=`71f0215a-eb00-4b39-ae27-9e41c243a3dc`::moving from state init -> state preparing >Thread-281::INFO::2013-12-12 13:06:00,075::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-281::INFO::2013-12-12 13:06:00,075::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-281::DEBUG::2013-12-12 13:06:00,076::task::1168::TaskManager.Task::(prepare) Task=`71f0215a-eb00-4b39-ae27-9e41c243a3dc`::finished: {} >Thread-281::DEBUG::2013-12-12 13:06:00,076::task::579::TaskManager.Task::(_updateState) Task=`71f0215a-eb00-4b39-ae27-9e41c243a3dc`::moving from state preparing -> state finished >Thread-281::DEBUG::2013-12-12 13:06:00,076::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-281::DEBUG::2013-12-12 13:06:00,076::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-281::DEBUG::2013-12-12 13:06:00,076::task::974::TaskManager.Task::(_decref) Task=`71f0215a-eb00-4b39-ae27-9e41c243a3dc`::ref 0 aborting False >Thread-283::DEBUG::2013-12-12 13:06:01,933::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeBrickAdd with ('foo', ['latest-a:/bricks/asdfasdfasdfsdf'], 0, 0, False) {} flowID [62cd110a] >Thread-283::DEBUG::2013-12-12 13:06:09,556::BindingXMLRPC::991::vds::(wrapper) return volumeBrickAdd with {'status': {'message': 'Done', 'code': 0}} >Thread-288::DEBUG::2013-12-12 13:06:15,158::task::579::TaskManager.Task::(_updateState) Task=`491a5055-37a3-45ed-8457-a757b5325e0d`::moving from state init -> state preparing >Thread-288::INFO::2013-12-12 13:06:15,158::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288::INFO::2013-12-12 13:06:15,158::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-288::DEBUG::2013-12-12 13:06:15,158::task::1168::TaskManager.Task::(prepare) Task=`491a5055-37a3-45ed-8457-a757b5325e0d`::finished: {} >Thread-288::DEBUG::2013-12-12 13:06:15,159::task::579::TaskManager.Task::(_updateState) Task=`491a5055-37a3-45ed-8457-a757b5325e0d`::moving from state preparing -> state finished >Thread-288::DEBUG::2013-12-12 13:06:15,159::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288::DEBUG::2013-12-12 13:06:15,159::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288::DEBUG::2013-12-12 13:06:15,159::task::974::TaskManager.Task::(_decref) Task=`491a5055-37a3-45ed-8457-a757b5325e0d`::ref 0 aborting False >Thread-290::DEBUG::2013-12-12 13:06:15,265::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-290::DEBUG::2013-12-12 13:06:15,598::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-291::DEBUG::2013-12-12 13:06:15,605::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-291::DEBUG::2013-12-12 13:06:15,773::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf', 'latest-b:/bricks/asdfsdfsadfadsfsaf', 'latest-a:/bricks/asdfasdfasdfsdf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-293::DEBUG::2013-12-12 13:06:20,797::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-293::DEBUG::2013-12-12 13:06:21,128::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-294::DEBUG::2013-12-12 13:06:21,136::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-294::DEBUG::2013-12-12 13:06:21,302::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf', 'latest-b:/bricks/asdfsdfsadfadsfsaf', 'latest-a:/bricks/asdfasdfasdfsdf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-297::DEBUG::2013-12-12 13:06:26,325::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-297::DEBUG::2013-12-12 13:06:28,964::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-299::DEBUG::2013-12-12 13:06:28,972::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-299::DEBUG::2013-12-12 13:06:29,196::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf', 'latest-b:/bricks/asdfsdfsadfadsfsaf', 'latest-a:/bricks/asdfasdfasdfsdf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-300::DEBUG::2013-12-12 13:06:30,359::task::579::TaskManager.Task::(_updateState) Task=`99c3a9ad-f339-4958-9724-acfe5edd5085`::moving from state init -> state preparing >Thread-300::INFO::2013-12-12 13:06:30,359::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-300::INFO::2013-12-12 13:06:30,359::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-300::DEBUG::2013-12-12 13:06:30,359::task::1168::TaskManager.Task::(prepare) Task=`99c3a9ad-f339-4958-9724-acfe5edd5085`::finished: {} >Thread-300::DEBUG::2013-12-12 13:06:30,360::task::579::TaskManager.Task::(_updateState) Task=`99c3a9ad-f339-4958-9724-acfe5edd5085`::moving from state preparing -> state finished >Thread-300::DEBUG::2013-12-12 13:06:30,360::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-300::DEBUG::2013-12-12 13:06:30,360::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-300::DEBUG::2013-12-12 13:06:30,360::task::974::TaskManager.Task::(_decref) Task=`99c3a9ad-f339-4958-9724-acfe5edd5085`::ref 0 aborting False >Thread-306::DEBUG::2013-12-12 13:06:45,276::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-307::DEBUG::2013-12-12 13:06:45,447::task::579::TaskManager.Task::(_updateState) Task=`4495cb8d-018e-4648-a49d-0ea2aefbe041`::moving from state init -> state preparing >Thread-307::INFO::2013-12-12 13:06:45,448::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-307::INFO::2013-12-12 13:06:45,448::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-307::DEBUG::2013-12-12 13:06:45,448::task::1168::TaskManager.Task::(prepare) Task=`4495cb8d-018e-4648-a49d-0ea2aefbe041`::finished: {} >Thread-307::DEBUG::2013-12-12 13:06:45,448::task::579::TaskManager.Task::(_updateState) Task=`4495cb8d-018e-4648-a49d-0ea2aefbe041`::moving from state preparing -> state finished >Thread-307::DEBUG::2013-12-12 13:06:45,448::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-307::DEBUG::2013-12-12 13:06:45,448::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-307::DEBUG::2013-12-12 13:06:45,449::task::974::TaskManager.Task::(_decref) Task=`4495cb8d-018e-4648-a49d-0ea2aefbe041`::ref 0 aborting False >Thread-306::DEBUG::2013-12-12 13:06:45,613::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-309::DEBUG::2013-12-12 13:06:45,621::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-309::DEBUG::2013-12-12 13:06:45,785::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf', 'latest-b:/bricks/asdfsdfsadfadsfsaf', 'latest-a:/bricks/asdfasdfasdfsdf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-311::DEBUG::2013-12-12 13:06:50,808::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-311::DEBUG::2013-12-12 13:06:51,140::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-312::DEBUG::2013-12-12 13:06:51,147::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-312::DEBUG::2013-12-12 13:06:51,315::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf', 'latest-b:/bricks/asdfsdfsadfadsfsaf', 'latest-a:/bricks/asdfasdfasdfsdf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-316::DEBUG::2013-12-12 13:07:00,540::task::579::TaskManager.Task::(_updateState) Task=`09375c28-1565-4ce0-b319-8a71267fcfac`::moving from state init -> state preparing >Thread-316::INFO::2013-12-12 13:07:00,540::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-316::INFO::2013-12-12 13:07:00,541::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-316::DEBUG::2013-12-12 13:07:00,541::task::1168::TaskManager.Task::(prepare) Task=`09375c28-1565-4ce0-b319-8a71267fcfac`::finished: {} >Thread-316::DEBUG::2013-12-12 13:07:00,541::task::579::TaskManager.Task::(_updateState) Task=`09375c28-1565-4ce0-b319-8a71267fcfac`::moving from state preparing -> state finished >Thread-316::DEBUG::2013-12-12 13:07:00,541::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-316::DEBUG::2013-12-12 13:07:00,541::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-316::DEBUG::2013-12-12 13:07:00,541::task::974::TaskManager.Task::(_decref) Task=`09375c28-1565-4ce0-b319-8a71267fcfac`::ref 0 aborting False >Thread-318::DEBUG::2013-12-12 13:07:02,055::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-318::DEBUG::2013-12-12 13:07:02,491::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {'333f0339-2b9f-45a0-916d-4ac6638c13a7': {'volume': 'foo', 'status': 'COMPLETED', 'type': 'REBALANCE', 'bricks': [], 'data': {'totalSizeMoved': '0', 'status': 'COMPLETED', 'filesSkipped': '0', 'filesFailed': '0', 'filesMoved': '0', 'runtime': '1.00', 'filesScanned': '0'}}}} >Thread-323::DEBUG::2013-12-12 13:07:15,630::task::579::TaskManager.Task::(_updateState) Task=`c6ff6969-5a03-46eb-8a59-01f8c836644b`::moving from state init -> state preparing >Thread-323::INFO::2013-12-12 13:07:15,630::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-323::INFO::2013-12-12 13:07:15,631::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-323::DEBUG::2013-12-12 13:07:15,631::task::1168::TaskManager.Task::(prepare) Task=`c6ff6969-5a03-46eb-8a59-01f8c836644b`::finished: {} >Thread-323::DEBUG::2013-12-12 13:07:15,631::task::579::TaskManager.Task::(_updateState) Task=`c6ff6969-5a03-46eb-8a59-01f8c836644b`::moving from state preparing -> state finished >Thread-323::DEBUG::2013-12-12 13:07:15,631::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-323::DEBUG::2013-12-12 13:07:15,631::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-323::DEBUG::2013-12-12 13:07:15,632::task::974::TaskManager.Task::(_decref) Task=`c6ff6969-5a03-46eb-8a59-01f8c836644b`::ref 0 aborting False >Thread-327::DEBUG::2013-12-12 13:07:23,982::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-327::DEBUG::2013-12-12 13:07:24,313::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-328::DEBUG::2013-12-12 13:07:24,320::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-328::DEBUG::2013-12-12 13:07:24,489::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf', 'latest-b:/bricks/asdfsdfsadfadsfsaf', 'latest-a:/bricks/asdfasdfasdfsdf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-331::DEBUG::2013-12-12 13:07:29,509::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-331::DEBUG::2013-12-12 13:07:29,839::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-332::DEBUG::2013-12-12 13:07:29,848::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-332::DEBUG::2013-12-12 13:07:30,016::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf', 'latest-b:/bricks/asdfsdfsadfadsfsaf', 'latest-a:/bricks/asdfasdfasdfsdf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-333::DEBUG::2013-12-12 13:07:30,723::task::579::TaskManager.Task::(_updateState) Task=`140911df-52f1-4039-a65a-3ac235d31f09`::moving from state init -> state preparing >Thread-333::INFO::2013-12-12 13:07:30,724::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-333::INFO::2013-12-12 13:07:30,724::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-333::DEBUG::2013-12-12 13:07:30,724::task::1168::TaskManager.Task::(prepare) Task=`140911df-52f1-4039-a65a-3ac235d31f09`::finished: {} >Thread-333::DEBUG::2013-12-12 13:07:30,724::task::579::TaskManager.Task::(_updateState) Task=`140911df-52f1-4039-a65a-3ac235d31f09`::moving from state preparing -> state finished >Thread-333::DEBUG::2013-12-12 13:07:30,724::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-333::DEBUG::2013-12-12 13:07:30,724::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-333::DEBUG::2013-12-12 13:07:30,725::task::974::TaskManager.Task::(_decref) Task=`140911df-52f1-4039-a65a-3ac235d31f09`::ref 0 aborting False >Thread-336::DEBUG::2013-12-12 13:07:35,036::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-336::DEBUG::2013-12-12 13:07:35,370::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-337::DEBUG::2013-12-12 13:07:35,380::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-337::DEBUG::2013-12-12 13:07:35,548::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf', 'latest-b:/bricks/asdfsdfsadfadsfsaf', 'latest-a:/bricks/asdfasdfasdfsdf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-340::DEBUG::2013-12-12 13:07:40,569::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-340::DEBUG::2013-12-12 13:07:40,901::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-341::DEBUG::2013-12-12 13:07:40,908::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-341::DEBUG::2013-12-12 13:07:41,074::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf', 'latest-b:/bricks/asdfsdfsadfadsfsaf', 'latest-a:/bricks/asdfasdfasdfsdf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-343::DEBUG::2013-12-12 13:07:45,909::task::579::TaskManager.Task::(_updateState) Task=`d49aef8e-bb77-460d-8281-4f692f9d7e45`::moving from state init -> state preparing >Thread-343::INFO::2013-12-12 13:07:45,909::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-343::INFO::2013-12-12 13:07:45,910::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-343::DEBUG::2013-12-12 13:07:45,910::task::1168::TaskManager.Task::(prepare) Task=`d49aef8e-bb77-460d-8281-4f692f9d7e45`::finished: {} >Thread-343::DEBUG::2013-12-12 13:07:45,910::task::579::TaskManager.Task::(_updateState) Task=`d49aef8e-bb77-460d-8281-4f692f9d7e45`::moving from state preparing -> state finished >Thread-343::DEBUG::2013-12-12 13:07:45,910::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-343::DEBUG::2013-12-12 13:07:45,910::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-343::DEBUG::2013-12-12 13:07:45,910::task::974::TaskManager.Task::(_decref) Task=`d49aef8e-bb77-460d-8281-4f692f9d7e45`::ref 0 aborting False >Thread-345::DEBUG::2013-12-12 13:07:46,094::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-345::DEBUG::2013-12-12 13:07:46,425::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-346::DEBUG::2013-12-12 13:07:46,432::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-346::DEBUG::2013-12-12 13:07:46,599::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf', 'latest-b:/bricks/asdfsdfsadfadsfsaf', 'latest-a:/bricks/asdfasdfasdfsdf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-348::DEBUG::2013-12-12 13:07:51,619::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-348::DEBUG::2013-12-12 13:07:51,950::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-349::DEBUG::2013-12-12 13:07:51,960::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-349::DEBUG::2013-12-12 13:07:52,131::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf', 'latest-b:/bricks/asdfsdfsadfadsfsaf', 'latest-a:/bricks/asdfasdfasdfsdf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-352::DEBUG::2013-12-12 13:07:57,149::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-352::DEBUG::2013-12-12 13:07:57,481::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-353::DEBUG::2013-12-12 13:07:57,489::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-353::DEBUG::2013-12-12 13:07:57,657::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf', 'latest-b:/bricks/asdfsdfsadfadsfsaf', 'latest-a:/bricks/asdfasdfasdfsdf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-355::DEBUG::2013-12-12 13:08:01,055::task::579::TaskManager.Task::(_updateState) Task=`947584a0-bd55-4c4a-9aa0-f5ac4ff8a164`::moving from state init -> state preparing >Thread-355::INFO::2013-12-12 13:08:01,055::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-355::INFO::2013-12-12 13:08:01,055::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-355::DEBUG::2013-12-12 13:08:01,055::task::1168::TaskManager.Task::(prepare) Task=`947584a0-bd55-4c4a-9aa0-f5ac4ff8a164`::finished: {} >Thread-355::DEBUG::2013-12-12 13:08:01,055::task::579::TaskManager.Task::(_updateState) Task=`947584a0-bd55-4c4a-9aa0-f5ac4ff8a164`::moving from state preparing -> state finished >Thread-355::DEBUG::2013-12-12 13:08:01,056::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-355::DEBUG::2013-12-12 13:08:01,056::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-355::DEBUG::2013-12-12 13:08:01,056::task::974::TaskManager.Task::(_decref) Task=`947584a0-bd55-4c4a-9aa0-f5ac4ff8a164`::ref 0 aborting False >Thread-359::DEBUG::2013-12-12 13:08:08,457::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-359::DEBUG::2013-12-12 13:08:08,789::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-360::DEBUG::2013-12-12 13:08:08,798::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-360::DEBUG::2013-12-12 13:08:08,965::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf', 'latest-b:/bricks/asdfsdfsadfadsfsaf', 'latest-a:/bricks/asdfasdfasdfsdf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-363::DEBUG::2013-12-12 13:08:16,136::task::579::TaskManager.Task::(_updateState) Task=`efffcd45-497c-4e7b-92ef-21f022819c67`::moving from state init -> state preparing >Thread-363::INFO::2013-12-12 13:08:16,136::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-363::INFO::2013-12-12 13:08:16,136::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-363::DEBUG::2013-12-12 13:08:16,136::task::1168::TaskManager.Task::(prepare) Task=`efffcd45-497c-4e7b-92ef-21f022819c67`::finished: {} >Thread-363::DEBUG::2013-12-12 13:08:16,136::task::579::TaskManager.Task::(_updateState) Task=`efffcd45-497c-4e7b-92ef-21f022819c67`::moving from state preparing -> state finished >Thread-363::DEBUG::2013-12-12 13:08:16,137::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-363::DEBUG::2013-12-12 13:08:16,137::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-363::DEBUG::2013-12-12 13:08:16,137::task::974::TaskManager.Task::(_decref) Task=`efffcd45-497c-4e7b-92ef-21f022819c67`::ref 0 aborting False >Thread-366::DEBUG::2013-12-12 13:08:19,507::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-366::DEBUG::2013-12-12 13:08:19,837::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-367::DEBUG::2013-12-12 13:08:19,844::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-367::DEBUG::2013-12-12 13:08:20,011::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf', 'latest-b:/bricks/asdfsdfsadfadsfsaf', 'latest-a:/bricks/asdfasdfasdfsdf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-371::DEBUG::2013-12-12 13:08:31,242::task::579::TaskManager.Task::(_updateState) Task=`c1491bdd-8467-492c-bc59-9fa148aa748e`::moving from state init -> state preparing >Thread-371::INFO::2013-12-12 13:08:31,243::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-371::INFO::2013-12-12 13:08:31,243::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-371::DEBUG::2013-12-12 13:08:31,243::task::1168::TaskManager.Task::(prepare) Task=`c1491bdd-8467-492c-bc59-9fa148aa748e`::finished: {} >Thread-371::DEBUG::2013-12-12 13:08:31,243::task::579::TaskManager.Task::(_updateState) Task=`c1491bdd-8467-492c-bc59-9fa148aa748e`::moving from state preparing -> state finished >Thread-371::DEBUG::2013-12-12 13:08:31,243::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-371::DEBUG::2013-12-12 13:08:31,244::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-371::DEBUG::2013-12-12 13:08:31,244::task::974::TaskManager.Task::(_decref) Task=`c1491bdd-8467-492c-bc59-9fa148aa748e`::ref 0 aborting False >Thread-376::DEBUG::2013-12-12 13:08:41,623::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-376::DEBUG::2013-12-12 13:08:41,952::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-377::DEBUG::2013-12-12 13:08:41,960::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-377::DEBUG::2013-12-12 13:08:42,129::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf', 'latest-b:/bricks/asdfsdfsadfadsfsaf', 'latest-a:/bricks/asdfasdfasdfsdf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-379::DEBUG::2013-12-12 13:08:46,326::task::579::TaskManager.Task::(_updateState) Task=`6bdb309d-99f7-4fe3-998f-43d71921f5ca`::moving from state init -> state preparing >Thread-379::INFO::2013-12-12 13:08:46,326::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-379::INFO::2013-12-12 13:08:46,326::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-379::DEBUG::2013-12-12 13:08:46,326::task::1168::TaskManager.Task::(prepare) Task=`6bdb309d-99f7-4fe3-998f-43d71921f5ca`::finished: {} >Thread-379::DEBUG::2013-12-12 13:08:46,327::task::579::TaskManager.Task::(_updateState) Task=`6bdb309d-99f7-4fe3-998f-43d71921f5ca`::moving from state preparing -> state finished >Thread-379::DEBUG::2013-12-12 13:08:46,327::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-379::DEBUG::2013-12-12 13:08:46,327::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-379::DEBUG::2013-12-12 13:08:46,327::task::974::TaskManager.Task::(_decref) Task=`6bdb309d-99f7-4fe3-998f-43d71921f5ca`::ref 0 aborting False >Thread-383::DEBUG::2013-12-12 13:08:52,696::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-383::DEBUG::2013-12-12 13:08:53,029::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-384::DEBUG::2013-12-12 13:08:53,040::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-384::DEBUG::2013-12-12 13:08:53,210::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf', 'latest-b:/bricks/asdfsdfsadfadsfsaf', 'latest-a:/bricks/asdfasdfasdfsdf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-386::DEBUG::2013-12-12 13:08:58,229::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-386::DEBUG::2013-12-12 13:08:58,571::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-388::DEBUG::2013-12-12 13:08:58,579::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-388::DEBUG::2013-12-12 13:08:58,745::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'foo': {'transportType': ['TCP'], 'uuid': '8de5e0bb-5151-4c53-b0ea-973b09c27e2d', 'bricks': ['latest-a:/bricks/asdf', 'latest-a:/bricks/asdfdsdf', 'latest-a:/bricks/asdfssasdfa', 'latest-b:/bricks/asdf', 'latest-b:/bricks/asdfsdf', 'latest-b:/bricks/asdfsdfasdf', 'latest-b:/bricks/asdfsdfasdfsa', 'latest-a:/bricks/asdfdfasdfasdf', 'latest-b:/bricks/asdfsdfsadfadsfsaf', 'latest-a:/bricks/asdfasdfasdfsdf'], 'volumeName': 'foo', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {'auth.allow': '*', 'nfs.disable': 'off', 'user.cifs': 'enable'}}}} >Thread-389::DEBUG::2013-12-12 13:09:01,416::task::579::TaskManager.Task::(_updateState) Task=`2993a5b1-41ff-4d12-bc17-44f3d9146139`::moving from state init -> state preparing >Thread-389::INFO::2013-12-12 13:09:01,416::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-389::INFO::2013-12-12 13:09:01,417::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-389::DEBUG::2013-12-12 13:09:01,417::task::1168::TaskManager.Task::(prepare) Task=`2993a5b1-41ff-4d12-bc17-44f3d9146139`::finished: {} >Thread-389::DEBUG::2013-12-12 13:09:01,417::task::579::TaskManager.Task::(_updateState) Task=`2993a5b1-41ff-4d12-bc17-44f3d9146139`::moving from state preparing -> state finished >Thread-389::DEBUG::2013-12-12 13:09:01,417::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-389::DEBUG::2013-12-12 13:09:01,417::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-389::DEBUG::2013-12-12 13:09:01,417::task::974::TaskManager.Task::(_decref) Task=`2993a5b1-41ff-4d12-bc17-44f3d9146139`::ref 0 aborting False >Thread-395::DEBUG::2013-12-12 13:09:16,502::task::579::TaskManager.Task::(_updateState) Task=`ae76e8a1-4d06-44fd-ba37-2ba95eb4f103`::moving from state init -> state preparing >Thread-395::INFO::2013-12-12 13:09:16,502::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-395::INFO::2013-12-12 13:09:16,502::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-395::DEBUG::2013-12-12 13:09:16,502::task::1168::TaskManager.Task::(prepare) Task=`ae76e8a1-4d06-44fd-ba37-2ba95eb4f103`::finished: {} >Thread-395::DEBUG::2013-12-12 13:09:16,502::task::579::TaskManager.Task::(_updateState) Task=`ae76e8a1-4d06-44fd-ba37-2ba95eb4f103`::moving from state preparing -> state finished >Thread-395::DEBUG::2013-12-12 13:09:16,502::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-395::DEBUG::2013-12-12 13:09:16,503::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-395::DEBUG::2013-12-12 13:09:16,503::task::974::TaskManager.Task::(_decref) Task=`ae76e8a1-4d06-44fd-ba37-2ba95eb4f103`::ref 0 aborting False >Thread-398::DEBUG::2013-12-12 13:09:22,040::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeDelete with ('foo',) {} flowID [5a5f91a5] >Thread-398::DEBUG::2013-12-12 13:09:22,212::BindingXMLRPC::991::vds::(wrapper) return volumeDelete with {'status': {'message': 'Done', 'code': 0}} >Thread-401::DEBUG::2013-12-12 13:09:25,974::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-401::DEBUG::2013-12-12 13:09:26,307::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-402::DEBUG::2013-12-12 13:09:26,317::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-402::DEBUG::2013-12-12 13:09:26,485::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-403::DEBUG::2013-12-12 13:09:27,910::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostRemove with ('latest-a', False) {} flowID [1611d24c] >Thread-403::DEBUG::2013-12-12 13:09:28,080::BindingXMLRPC::991::vds::(wrapper) return hostRemove with {'status': {'message': 'Done', 'code': 0}} >Thread-405::DEBUG::2013-12-12 13:09:31,601::task::579::TaskManager.Task::(_updateState) Task=`95a21ced-cb21-4e8b-8d54-085b5b72fa7e`::moving from state init -> state preparing >Thread-405::INFO::2013-12-12 13:09:31,601::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-405::INFO::2013-12-12 13:09:31,601::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-405::DEBUG::2013-12-12 13:09:31,601::task::1168::TaskManager.Task::(prepare) Task=`95a21ced-cb21-4e8b-8d54-085b5b72fa7e`::finished: {} >Thread-405::DEBUG::2013-12-12 13:09:31,601::task::579::TaskManager.Task::(_updateState) Task=`95a21ced-cb21-4e8b-8d54-085b5b72fa7e`::moving from state preparing -> state finished >Thread-405::DEBUG::2013-12-12 13:09:31,602::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-405::DEBUG::2013-12-12 13:09:31,602::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-405::DEBUG::2013-12-12 13:09:31,602::task::974::TaskManager.Task::(_decref) Task=`95a21ced-cb21-4e8b-8d54-085b5b72fa7e`::ref 0 aborting False >MainThread::DEBUG::2013-12-12 13:10:32,052::vdsm::45::vds::(sigtermHandler) Received signal 15 >MainThread::INFO::2013-12-12 13:10:32,680::vmChannels::183::vds::(stop) VM channels listener was stopped. >MainThread::DEBUG::2013-12-12 13:10:32,680::task::579::TaskManager.Task::(_updateState) Task=`331bfeb2-de3f-40ce-9add-021eeab2d604`::moving from state init -> state preparing >MainThread::INFO::2013-12-12 13:10:32,680::logUtils::44::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2013-12-12 13:10:32,706::storageServer::698::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::INFO::2013-12-12 13:10:32,952::domainMonitor::126::Storage.DomainMonitor::(close) Stopping domain monitors >MainThread::DEBUG::2013-12-12 13:10:32,952::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2013-12-12 13:10:32,952::logUtils::47::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2013-12-12 13:10:32,953::task::1168::TaskManager.Task::(prepare) Task=`331bfeb2-de3f-40ce-9add-021eeab2d604`::finished: None >MainThread::DEBUG::2013-12-12 13:10:32,953::task::579::TaskManager.Task::(_updateState) Task=`331bfeb2-de3f-40ce-9add-021eeab2d604`::moving from state preparing -> state finished >MainThread::DEBUG::2013-12-12 13:10:32,953::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-12-12 13:10:32,953::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-12-12 13:10:32,953::task::974::TaskManager.Task::(_decref) Task=`331bfeb2-de3f-40ce-9add-021eeab2d604`::ref 0 aborting False >MainThread::INFO::2013-12-12 13:10:32,953::vdsm::107::vds::(run) VDSM main thread ended. Waiting for 13 other threads... >MainThread::INFO::2013-12-12 13:10:32,954::vdsm::111::vds::(run) <_MainThread(MainThread, started 139808222906112)> >MainThread::INFO::2013-12-12 13:10:32,954::vdsm::111::vds::(run) <Thread(libvirtEventLoop, started daemon 139808128333568)> >MainThread::INFO::2013-12-12 13:10:32,954::vdsm::111::vds::(run) <WorkerThread(Thread-8, started daemon 139807720191744)> >MainThread::INFO::2013-12-12 13:10:32,954::vdsm::111::vds::(run) <WorkerThread(Thread-10, started daemon 139807493715712)> >MainThread::INFO::2013-12-12 13:10:32,954::vdsm::111::vds::(run) <WorkerThread(Thread-7, started daemon 139807730681600)> >MainThread::INFO::2013-12-12 13:10:32,954::vdsm::111::vds::(run) <WorkerThread(Thread-6, started daemon 139807741171456)> >MainThread::INFO::2013-12-12 13:10:32,955::vdsm::111::vds::(run) <WorkerThread(Thread-9, started daemon 139807709701888)> >MainThread::INFO::2013-12-12 13:10:32,955::vdsm::111::vds::(run) <WorkerThread(Thread-5, started daemon 139807751661312)> >MainThread::INFO::2013-12-12 13:10:32,955::vdsm::111::vds::(run) <KsmMonitorThread(KsmMonitor, started daemon 139807451756288)> >MainThread::INFO::2013-12-12 13:10:32,955::vdsm::111::vds::(run) <WorkerThread(Thread-4, started daemon 139807762151168)> >MainThread::INFO::2013-12-12 13:10:32,955::vmChannels::183::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2013-12-12 13:10:32,955::vdsm::111::vds::(run) <Listener(VM Channels Listener, started daemon 139807359497984)> >MainThread::INFO::2013-12-12 13:10:32,955::vdsm::111::vds::(run) <WorkerThread(Thread-1, started daemon 139808003139328)> >MainThread::INFO::2013-12-12 13:10:32,956::vdsm::111::vds::(run) <WorkerThread(Thread-2, started daemon 139807992649472)> >MainThread::INFO::2013-12-12 13:10:32,956::vdsm::111::vds::(run) <WorkerThread(Thread-3, started daemon 139807982159616)> >MainThread::INFO::2013-12-12 13:10:45,826::vdsm::101::vds::(run) (PID: 8116) I am the actual vdsm 4.13.0-23.1.el6rhs rhs-21u2-20131208-b (2.6.32-358.28.1.el6.x86_64) >MainThread::DEBUG::2013-12-12 13:10:46,076::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2013-12-12 13:10:46,076::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2013-12-12 13:10:46,081::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2013-12-12 13:10:46,626::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::INFO::2013-12-12 13:10:46,644::multipath::134::Storage.Multipath::(isEnabled) Manual override for multipath.conf detected - preserving current configuration >MainThread::WARNING::2013-12-12 13:10:46,644::multipath::137::Storage.Multipath::(isEnabled) This manual override for multipath.conf was based on downrevved template. You are strongly advised to contact your support representatives >MainThread::DEBUG::2013-12-12 13:10:46,644::hsm::426::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2013-12-12 13:10:46,684::hsm::426::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-12-12 13:10:46,684::hsm::450::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2013-12-12 13:10:46,687::hsm::482::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2013-12-12 13:10:46,687::hsm::483::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2013-12-12 13:10:46,687::hsm::485::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2013-12-12 13:10:46,688::hsm::528::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2013-12-12 13:10:46,691::dispatcher::98::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >MainThread::DEBUG::2013-12-12 13:10:46,691::task::579::TaskManager.Task::(_updateState) Task=`56951d16-d77f-4a9e-b62b-814a0ab7252c`::moving from state init -> state preparing >MainThread::INFO::2013-12-12 13:10:46,691::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0x7f0e0c226200>>) >MainThread::INFO::2013-12-12 13:10:46,692::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None >MainThread::DEBUG::2013-12-12 13:10:46,692::task::1168::TaskManager.Task::(prepare) Task=`56951d16-d77f-4a9e-b62b-814a0ab7252c`::finished: None >MainThread::DEBUG::2013-12-12 13:10:46,692::task::579::TaskManager.Task::(_updateState) Task=`56951d16-d77f-4a9e-b62b-814a0ab7252c`::moving from state preparing -> state finished >MainThread::DEBUG::2013-12-12 13:10:46,692::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-12-12 13:10:46,692::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-12-12 13:10:46,692::task::974::TaskManager.Task::(_decref) Task=`56951d16-d77f-4a9e-b62b-814a0ab7252c`::ref 0 aborting False >storageRefresh::DEBUG::2013-12-12 13:10:46,697::lvm::338::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 13:10:46,698::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::WARNING::2013-12-12 13:10:46,706::clientIF::196::vds::(_prepareMOM) MOM is not available, fallback to KsmMonitor >MainThread::DEBUG::2013-12-12 13:10:46,707::utils::489::root::(execCmd) '/usr/bin/pgrep -xf ksmd' (cwd None) >MainThread::DEBUG::2013-12-12 13:10:46,739::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2013-12-12 13:10:46,739::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 29 >storageRefresh::DEBUG::2013-12-12 13:10:46,767::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 13:10:46,767::lvm::363::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 13:10:46,768::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 13:10:46,768::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >KsmMonitor::DEBUG::2013-12-12 13:10:46,777::utils::489::root::(execCmd) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2013-12-12 13:10:46,786::vmChannels::187::vds::(settimeout) Setting channels' timeout to 30 seconds. >clientIFinit::DEBUG::2013-12-12 13:10:46,786::libvirtconnection::131::libvirtconnection::(get) trying to connect libvirt >storageRefresh::DEBUG::2013-12-12 13:10:46,821::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 13:10:46,821::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 13:10:46,822::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >VM Channels Listener::INFO::2013-12-12 13:10:46,838::vmChannels::170::vds::(run) Starting VM channels listener thread. >storageRefresh::DEBUG::2013-12-12 13:10:46,873::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 13:10:46,873::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 13:10:46,874::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >storageRefresh::DEBUG::2013-12-12 13:10:46,934::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 13:10:46,934::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 13:10:46,935::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >storageRefresh::DEBUG::2013-12-12 13:10:46,935::misc::811::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-12-12 13:10:46,935::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2013-12-12 13:10:46,935::misc::811::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-12-12 13:10:46,936::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2013-12-12 13:10:46,977::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >storageRefresh::DEBUG::2013-12-12 13:10:46,977::misc::819::SamplingMethod::(__call__) Returning last result >Thread-13::DEBUG::2013-12-12 13:10:47,435::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call ping with () {} flowID [6e4381a1] >Thread-13::DEBUG::2013-12-12 13:10:47,435::BindingXMLRPC::991::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-14::DEBUG::2013-12-12 13:10:47,441::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getCapabilities with () {} flowID [6e4381a1] >Thread-14::DEBUG::2013-12-12 13:10:47,509::utils::489::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-14::DEBUG::2013-12-12 13:10:47,529::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2013-12-12 13:10:47,553::caps::363::root::(_getKeyPackages) rpm package glusterfs-rdma not found >Thread-14::DEBUG::2013-12-12 13:10:47,553::caps::363::root::(_getKeyPackages) rpm package glusterfs-fuse not found >Thread-14::DEBUG::2013-12-12 13:10:47,554::caps::363::root::(_getKeyPackages) rpm package gluster-swift not found >Thread-14::DEBUG::2013-12-12 13:10:47,555::caps::363::root::(_getKeyPackages) rpm package qemu-kvm-rhev not found >Thread-14::DEBUG::2013-12-12 13:10:47,555::caps::363::root::(_getKeyPackages) rpm package gluster-swift-object not found >Thread-14::DEBUG::2013-12-12 13:10:47,555::caps::363::root::(_getKeyPackages) rpm package glusterfs not found >Thread-14::DEBUG::2013-12-12 13:10:47,556::caps::363::root::(_getKeyPackages) rpm package gluster-swift-plugin not found >Thread-14::DEBUG::2013-12-12 13:10:47,557::caps::363::root::(_getKeyPackages) rpm package qemu-img-rhev not found >Thread-14::DEBUG::2013-12-12 13:10:47,557::caps::363::root::(_getKeyPackages) rpm package ('mom',) not found >Thread-14::DEBUG::2013-12-12 13:10:47,557::caps::363::root::(_getKeyPackages) rpm package gluster-swift-account not found >Thread-14::DEBUG::2013-12-12 13:10:47,558::caps::363::root::(_getKeyPackages) rpm package gluster-swift-proxy not found >Thread-14::DEBUG::2013-12-12 13:10:47,558::caps::363::root::(_getKeyPackages) rpm package gluster-swift-doc not found >Thread-14::DEBUG::2013-12-12 13:10:47,558::caps::363::root::(_getKeyPackages) rpm package glusterfs-server not found >Thread-14::DEBUG::2013-12-12 13:10:47,559::caps::363::root::(_getKeyPackages) rpm package gluster-swift-container not found >Thread-14::DEBUG::2013-12-12 13:10:47,559::caps::363::root::(_getKeyPackages) rpm package glusterfs-geo-replication not found >Thread-14::DEBUG::2013-12-12 13:10:47,562::BindingXMLRPC::991::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.28.1.el6.x86_64', 'buildtime': 1384533955.0, 'version': '2.6.32'}, 'vdsm': {'release': '23.1.el6rhs', 'buildtime': 1386773756L, 'version': '4.13.0'}, 'spice-server': {'release': '12.el6_4.5', 'buildtime': 1381834662L, 'version': '0.12.0'}, 'libvirt': {'release': '18.el6_4.13', 'buildtime': 1379320058L, 'version': '0.10.2'}}, 'cpuModel': 'QEMU Virtual CPU version 1.4.2', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.14.16.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.14.16.254', 'ports': ['eth0']}}, 'uuid': '7B904C94-94EE-7B49-40B3-BD3C28FBB749', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'netmask': '', 'addr': '', 'hwaddr': '52:54:00:b7:60:bc', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': '52:54:00:b7:60:bc', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 100, 'mtu': '1500'}}, 'software_revision': '23.1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': 'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,lm,up,rep_good,unfair_spinlock,pni,cx16,popcnt,hypervisor,lahf_lm', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '4062', 'cpuSpeed': '2393.998', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '1', 'kvmEnabled': 'false', 'rhsVersion': {'release': '1.el6rhs', 'version': '2.1.2.0', 'name': 'RHS'}, 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '1', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.14.16.112'}} >Thread-15::DEBUG::2013-12-12 13:10:50,484::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getCapabilities with () {} >Thread-15::DEBUG::2013-12-12 13:10:50,485::utils::489::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-15::DEBUG::2013-12-12 13:10:50,490::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2013-12-12 13:10:50,501::caps::363::root::(_getKeyPackages) rpm package glusterfs-rdma not found >Thread-15::DEBUG::2013-12-12 13:10:50,502::caps::363::root::(_getKeyPackages) rpm package glusterfs-fuse not found >Thread-15::DEBUG::2013-12-12 13:10:50,502::caps::363::root::(_getKeyPackages) rpm package gluster-swift not found >Thread-15::DEBUG::2013-12-12 13:10:50,503::caps::363::root::(_getKeyPackages) rpm package qemu-kvm-rhev not found >Thread-15::DEBUG::2013-12-12 13:10:50,503::caps::363::root::(_getKeyPackages) rpm package gluster-swift-object not found >Thread-15::DEBUG::2013-12-12 13:10:50,504::caps::363::root::(_getKeyPackages) rpm package glusterfs not found >Thread-15::DEBUG::2013-12-12 13:10:50,504::caps::363::root::(_getKeyPackages) rpm package gluster-swift-plugin not found >Thread-15::DEBUG::2013-12-12 13:10:50,505::caps::363::root::(_getKeyPackages) rpm package qemu-img-rhev not found >Thread-15::DEBUG::2013-12-12 13:10:50,505::caps::363::root::(_getKeyPackages) rpm package ('mom',) not found >Thread-15::DEBUG::2013-12-12 13:10:50,506::caps::363::root::(_getKeyPackages) rpm package gluster-swift-account not found >Thread-15::DEBUG::2013-12-12 13:10:50,506::caps::363::root::(_getKeyPackages) rpm package gluster-swift-proxy not found >Thread-15::DEBUG::2013-12-12 13:10:50,506::caps::363::root::(_getKeyPackages) rpm package gluster-swift-doc not found >Thread-15::DEBUG::2013-12-12 13:10:50,507::caps::363::root::(_getKeyPackages) rpm package glusterfs-server not found >Thread-15::DEBUG::2013-12-12 13:10:50,507::caps::363::root::(_getKeyPackages) rpm package gluster-swift-container not found >Thread-15::DEBUG::2013-12-12 13:10:50,507::caps::363::root::(_getKeyPackages) rpm package glusterfs-geo-replication not found >Thread-15::DEBUG::2013-12-12 13:10:50,508::BindingXMLRPC::991::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.28.1.el6.x86_64', 'buildtime': 1384533955.0, 'version': '2.6.32'}, 'vdsm': {'release': '23.1.el6rhs', 'buildtime': 1386773756L, 'version': '4.13.0'}, 'spice-server': {'release': '12.el6_4.5', 'buildtime': 1381834662L, 'version': '0.12.0'}, 'libvirt': {'release': '18.el6_4.13', 'buildtime': 1379320058L, 'version': '0.10.2'}}, 'cpuModel': 'QEMU Virtual CPU version 1.4.2', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.14.16.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.14.16.254', 'ports': ['eth0']}}, 'uuid': '7B904C94-94EE-7B49-40B3-BD3C28FBB749', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'netmask': '', 'addr': '', 'hwaddr': '52:54:00:b7:60:bc', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': '52:54:00:b7:60:bc', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 100, 'mtu': '1500'}}, 'software_revision': '23.1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': 'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,lm,up,rep_good,unfair_spinlock,pni,cx16,popcnt,hypervisor,lahf_lm', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '4062', 'cpuSpeed': '2393.998', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '1', 'kvmEnabled': 'false', 'rhsVersion': {'release': '1.el6rhs', 'version': '2.1.2.0', 'name': 'RHS'}, 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '1', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.14.16.112'}} >Thread-16::DEBUG::2013-12-12 13:10:50,520::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getHardwareInfo with () {} >Thread-16::DEBUG::2013-12-12 13:10:50,544::BindingXMLRPC::991::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'Bochs', 'systemSerialNumber': 'Not Specified', 'systemFamily': 'Not Specified', 'systemVersion': 'Not Specified', 'systemUUID': '7b904c94-94ee-7b49-40b3-bd3c28fbb749', 'systemManufacturer': 'Bochs'}} >Thread-17::DEBUG::2013-12-12 13:10:50,566::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-17::DEBUG::2013-12-12 13:10:50,901::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}]} >Thread-18::DEBUG::2013-12-12 13:10:50,907::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getCapabilities with () {} >Thread-18::DEBUG::2013-12-12 13:10:50,907::utils::489::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-18::DEBUG::2013-12-12 13:10:50,912::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2013-12-12 13:10:50,924::caps::363::root::(_getKeyPackages) rpm package glusterfs-rdma not found >Thread-18::DEBUG::2013-12-12 13:10:50,924::caps::363::root::(_getKeyPackages) rpm package glusterfs-fuse not found >Thread-18::DEBUG::2013-12-12 13:10:50,925::caps::363::root::(_getKeyPackages) rpm package gluster-swift not found >Thread-18::DEBUG::2013-12-12 13:10:50,925::caps::363::root::(_getKeyPackages) rpm package qemu-kvm-rhev not found >Thread-18::DEBUG::2013-12-12 13:10:50,926::caps::363::root::(_getKeyPackages) rpm package gluster-swift-object not found >Thread-18::DEBUG::2013-12-12 13:10:50,926::caps::363::root::(_getKeyPackages) rpm package glusterfs not found >Thread-18::DEBUG::2013-12-12 13:10:50,926::caps::363::root::(_getKeyPackages) rpm package gluster-swift-plugin not found >Thread-18::DEBUG::2013-12-12 13:10:50,928::caps::363::root::(_getKeyPackages) rpm package qemu-img-rhev not found >Thread-18::DEBUG::2013-12-12 13:10:50,928::caps::363::root::(_getKeyPackages) rpm package ('mom',) not found >Thread-18::DEBUG::2013-12-12 13:10:50,928::caps::363::root::(_getKeyPackages) rpm package gluster-swift-account not found >Thread-18::DEBUG::2013-12-12 13:10:50,928::caps::363::root::(_getKeyPackages) rpm package gluster-swift-proxy not found >Thread-18::DEBUG::2013-12-12 13:10:50,929::caps::363::root::(_getKeyPackages) rpm package gluster-swift-doc not found >Thread-18::DEBUG::2013-12-12 13:10:50,929::caps::363::root::(_getKeyPackages) rpm package glusterfs-server not found >Thread-18::DEBUG::2013-12-12 13:10:50,929::caps::363::root::(_getKeyPackages) rpm package gluster-swift-container not found >Thread-18::DEBUG::2013-12-12 13:10:50,930::caps::363::root::(_getKeyPackages) rpm package glusterfs-geo-replication not found >Thread-18::DEBUG::2013-12-12 13:10:50,931::BindingXMLRPC::991::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.28.1.el6.x86_64', 'buildtime': 1384533955.0, 'version': '2.6.32'}, 'vdsm': {'release': '23.1.el6rhs', 'buildtime': 1386773756L, 'version': '4.13.0'}, 'spice-server': {'release': '12.el6_4.5', 'buildtime': 1381834662L, 'version': '0.12.0'}, 'libvirt': {'release': '18.el6_4.13', 'buildtime': 1379320058L, 'version': '0.10.2'}}, 'cpuModel': 'QEMU Virtual CPU version 1.4.2', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.14.16.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.14.16.254', 'ports': ['eth0']}}, 'uuid': '7B904C94-94EE-7B49-40B3-BD3C28FBB749', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'netmask': '', 'addr': '', 'hwaddr': '52:54:00:b7:60:bc', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': '52:54:00:b7:60:bc', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 100, 'mtu': '1500'}}, 'software_revision': '23.1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': 'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,lm,up,rep_good,unfair_spinlock,pni,cx16,popcnt,hypervisor,lahf_lm', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '4062', 'cpuSpeed': '2393.998', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '1', 'kvmEnabled': 'false', 'rhsVersion': {'release': '1.el6rhs', 'version': '2.1.2.0', 'name': 'RHS'}, 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '1', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.14.16.112'}} >Thread-19::DEBUG::2013-12-12 13:10:50,942::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getHardwareInfo with () {} >Thread-19::DEBUG::2013-12-12 13:10:50,944::BindingXMLRPC::991::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'Bochs', 'systemSerialNumber': 'Not Specified', 'systemFamily': 'Not Specified', 'systemVersion': 'Not Specified', 'systemUUID': '7b904c94-94ee-7b49-40b3-bd3c28fbb749', 'systemManufacturer': 'Bochs'}} >Thread-20::DEBUG::2013-12-12 13:10:51,000::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >storageRefresh::DEBUG::2013-12-12 13:10:51,008::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >storageRefresh::DEBUG::2013-12-12 13:10:51,030::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 13:10:51,030::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 13:10:51,030::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 13:10:51,031::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 13:10:51,031::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 13:10:51,031::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 13:10:51,031::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 13:10:51,032::misc::819::SamplingMethod::(__call__) Returning last result >storageRefresh::WARNING::2013-12-12 13:10:51,032::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >Thread-20::DEBUG::2013-12-12 13:10:51,347::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}]} >Thread-22::DEBUG::2013-12-12 13:10:51,372::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostUUIDGet with () {} flowID [3741e945] >Thread-22::DEBUG::2013-12-12 13:10:51,537::BindingXMLRPC::991::vds::(wrapper) return hostUUIDGet with {'status': {'message': 'Done', 'code': 0}, 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'} >KsmMonitor::DEBUG::2013-12-12 13:10:53,005::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2013-12-12 13:10:53,006::utils::489::root::(execCmd) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2013-12-12 13:10:53,053::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-23::DEBUG::2013-12-12 13:10:53,640::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-23::DEBUG::2013-12-12 13:10:54,273::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-24::DEBUG::2013-12-12 13:10:54,282::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-24::DEBUG::2013-12-12 13:10:54,449::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {}} >Thread-28::DEBUG::2013-12-12 13:11:04,001::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeStart with ('StartMigrationDuringRebalanceTest', False) {} flowID [71cd9bd] >Thread-29::DEBUG::2013-12-12 13:11:05,244::task::579::TaskManager.Task::(_updateState) Task=`ac0ecfee-8018-454b-9417-89f3444b0249`::moving from state init -> state preparing >Thread-29::INFO::2013-12-12 13:11:05,245::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-29::INFO::2013-12-12 13:11:05,245::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-29::DEBUG::2013-12-12 13:11:05,245::task::1168::TaskManager.Task::(prepare) Task=`ac0ecfee-8018-454b-9417-89f3444b0249`::finished: {} >Thread-29::DEBUG::2013-12-12 13:11:05,245::task::579::TaskManager.Task::(_updateState) Task=`ac0ecfee-8018-454b-9417-89f3444b0249`::moving from state preparing -> state finished >Thread-29::DEBUG::2013-12-12 13:11:05,245::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-29::DEBUG::2013-12-12 13:11:05,246::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-29::DEBUG::2013-12-12 13:11:05,246::task::974::TaskManager.Task::(_decref) Task=`ac0ecfee-8018-454b-9417-89f3444b0249`::ref 0 aborting False >Thread-28::DEBUG::2013-12-12 13:11:08,457::BindingXMLRPC::991::vds::(wrapper) return volumeStart with {'status': {'message': 'Done', 'code': 0}} >Thread-32::DEBUG::2013-12-12 13:11:08,617::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-32::DEBUG::2013-12-12 13:11:08,946::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-33::DEBUG::2013-12-12 13:11:08,954::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-33::DEBUG::2013-12-12 13:11:09,118::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '710d037b-f0d7-4460-b13c-cea331ee8ac9', 'bricks': ['latest-a:/bricks/201312121310559151942637805', 'latest-a:/bricks/20131212131056815850249563', 'latest-a:/bricks/201312121310568151245056192', 'latest-b:/bricks/20131212131056815550199115', 'latest-b:/bricks/20131212131056815516730110', 'latest-b:/bricks/201312121310568161287551485'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-35::DEBUG::2013-12-12 13:11:14,136::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-35::DEBUG::2013-12-12 13:11:14,484::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-37::DEBUG::2013-12-12 13:11:14,495::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-37::DEBUG::2013-12-12 13:11:14,664::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '710d037b-f0d7-4460-b13c-cea331ee8ac9', 'bricks': ['latest-a:/bricks/201312121310559151942637805', 'latest-a:/bricks/20131212131056815850249563', 'latest-a:/bricks/201312121310568151245056192', 'latest-b:/bricks/20131212131056815550199115', 'latest-b:/bricks/20131212131056815516730110', 'latest-b:/bricks/201312121310568161287551485'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-39::DEBUG::2013-12-12 13:11:20,433::task::579::TaskManager.Task::(_updateState) Task=`85c1052a-cb69-4be0-b59e-c6544018743e`::moving from state init -> state preparing >Thread-39::INFO::2013-12-12 13:11:20,434::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-39::INFO::2013-12-12 13:11:20,434::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-39::DEBUG::2013-12-12 13:11:20,434::task::1168::TaskManager.Task::(prepare) Task=`85c1052a-cb69-4be0-b59e-c6544018743e`::finished: {} >Thread-39::DEBUG::2013-12-12 13:11:20,434::task::579::TaskManager.Task::(_updateState) Task=`85c1052a-cb69-4be0-b59e-c6544018743e`::moving from state preparing -> state finished >Thread-39::DEBUG::2013-12-12 13:11:20,434::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-39::DEBUG::2013-12-12 13:11:20,435::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-39::DEBUG::2013-12-12 13:11:20,435::task::974::TaskManager.Task::(_decref) Task=`85c1052a-cb69-4be0-b59e-c6544018743e`::ref 0 aborting False >Thread-44::DEBUG::2013-12-12 13:11:31,084::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeBrickAdd with ('StartMigrationDuringRebalanceTest', ['latest-b:/bricks/20131212131131033219930446'], 0, 0, False) {} flowID [1c521b9] >Thread-46::DEBUG::2013-12-12 13:11:35,545::task::579::TaskManager.Task::(_updateState) Task=`d733e55e-d3db-4118-921a-45650059a5a4`::moving from state init -> state preparing >Thread-46::INFO::2013-12-12 13:11:35,545::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-46::INFO::2013-12-12 13:11:35,545::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-46::DEBUG::2013-12-12 13:11:35,545::task::1168::TaskManager.Task::(prepare) Task=`d733e55e-d3db-4118-921a-45650059a5a4`::finished: {} >Thread-46::DEBUG::2013-12-12 13:11:35,546::task::579::TaskManager.Task::(_updateState) Task=`d733e55e-d3db-4118-921a-45650059a5a4`::moving from state preparing -> state finished >Thread-46::DEBUG::2013-12-12 13:11:35,546::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-46::DEBUG::2013-12-12 13:11:35,546::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-46::DEBUG::2013-12-12 13:11:35,546::task::974::TaskManager.Task::(_decref) Task=`d733e55e-d3db-4118-921a-45650059a5a4`::ref 0 aborting False >Thread-44::DEBUG::2013-12-12 13:11:38,335::BindingXMLRPC::991::vds::(wrapper) return volumeBrickAdd with {'status': {'message': 'Done', 'code': 0}} >Thread-49::DEBUG::2013-12-12 13:11:39,319::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeBrickAdd with ('StartMigrationDuringRebalanceTest', ['latest-a:/bricks/201312121311391031151947411'], 0, 0, False) {} flowID [29a7d9a8] >Thread-49::DEBUG::2013-12-12 13:11:47,187::BindingXMLRPC::991::vds::(wrapper) return volumeBrickAdd with {'status': {'message': 'Done', 'code': 0}} >Thread-53::DEBUG::2013-12-12 13:11:50,689::task::579::TaskManager.Task::(_updateState) Task=`baa091ac-f505-48cf-aa22-30fa1f6e116b`::moving from state init -> state preparing >Thread-53::INFO::2013-12-12 13:11:50,689::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53::INFO::2013-12-12 13:11:50,689::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-53::DEBUG::2013-12-12 13:11:50,689::task::1168::TaskManager.Task::(prepare) Task=`baa091ac-f505-48cf-aa22-30fa1f6e116b`::finished: {} >Thread-53::DEBUG::2013-12-12 13:11:50,690::task::579::TaskManager.Task::(_updateState) Task=`baa091ac-f505-48cf-aa22-30fa1f6e116b`::moving from state preparing -> state finished >Thread-53::DEBUG::2013-12-12 13:11:50,690::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53::DEBUG::2013-12-12 13:11:50,690::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53::DEBUG::2013-12-12 13:11:50,690::task::974::TaskManager.Task::(_decref) Task=`baa091ac-f505-48cf-aa22-30fa1f6e116b`::ref 0 aborting False >Thread-57::DEBUG::2013-12-12 13:11:58,418::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-57::DEBUG::2013-12-12 13:11:58,753::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-58::DEBUG::2013-12-12 13:11:58,763::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-58::DEBUG::2013-12-12 13:11:58,935::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '710d037b-f0d7-4460-b13c-cea331ee8ac9', 'bricks': ['latest-a:/bricks/201312121310559151942637805', 'latest-a:/bricks/20131212131056815850249563', 'latest-a:/bricks/201312121310568151245056192', 'latest-b:/bricks/20131212131056815550199115', 'latest-b:/bricks/20131212131056815516730110', 'latest-b:/bricks/201312121310568161287551485', 'latest-b:/bricks/20131212131115583927299489', 'latest-a:/bricks/20131212131123545341374234', 'latest-b:/bricks/20131212131131033219930446', 'latest-a:/bricks/201312121311391031151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-61::DEBUG::2013-12-12 13:12:03,959::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-61::DEBUG::2013-12-12 13:12:04,289::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-62::DEBUG::2013-12-12 13:12:04,300::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-62::DEBUG::2013-12-12 13:12:04,465::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '710d037b-f0d7-4460-b13c-cea331ee8ac9', 'bricks': ['latest-a:/bricks/201312121310559151942637805', 'latest-a:/bricks/20131212131056815850249563', 'latest-a:/bricks/201312121310568151245056192', 'latest-b:/bricks/20131212131056815550199115', 'latest-b:/bricks/20131212131056815516730110', 'latest-b:/bricks/201312121310568161287551485', 'latest-b:/bricks/20131212131115583927299489', 'latest-a:/bricks/20131212131123545341374234', 'latest-b:/bricks/20131212131131033219930446', 'latest-a:/bricks/201312121311391031151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-63::DEBUG::2013-12-12 13:12:05,812::task::579::TaskManager.Task::(_updateState) Task=`688824e1-d089-427a-9f3a-788d38c31d9c`::moving from state init -> state preparing >Thread-63::INFO::2013-12-12 13:12:05,812::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-63::INFO::2013-12-12 13:12:05,812::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-63::DEBUG::2013-12-12 13:12:05,813::task::1168::TaskManager.Task::(prepare) Task=`688824e1-d089-427a-9f3a-788d38c31d9c`::finished: {} >Thread-63::DEBUG::2013-12-12 13:12:05,813::task::579::TaskManager.Task::(_updateState) Task=`688824e1-d089-427a-9f3a-788d38c31d9c`::moving from state preparing -> state finished >Thread-63::DEBUG::2013-12-12 13:12:05,813::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-63::DEBUG::2013-12-12 13:12:05,813::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-63::DEBUG::2013-12-12 13:12:05,813::task::974::TaskManager.Task::(_decref) Task=`688824e1-d089-427a-9f3a-788d38c31d9c`::ref 0 aborting False >Thread-68::DEBUG::2013-12-12 13:12:15,013::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-68::DEBUG::2013-12-12 13:12:15,337::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-69::DEBUG::2013-12-12 13:12:15,345::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-69::DEBUG::2013-12-12 13:12:15,509::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '710d037b-f0d7-4460-b13c-cea331ee8ac9', 'bricks': ['latest-a:/bricks/201312121310559151942637805', 'latest-a:/bricks/20131212131056815850249563', 'latest-a:/bricks/201312121310568151245056192', 'latest-b:/bricks/20131212131056815550199115', 'latest-b:/bricks/20131212131056815516730110', 'latest-b:/bricks/201312121310568161287551485', 'latest-b:/bricks/20131212131115583927299489', 'latest-a:/bricks/20131212131123545341374234', 'latest-b:/bricks/20131212131131033219930446', 'latest-a:/bricks/201312121311391031151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-71::DEBUG::2013-12-12 13:12:20,531::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-71::DEBUG::2013-12-12 13:12:20,859::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-72::DEBUG::2013-12-12 13:12:20,866::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-73::DEBUG::2013-12-12 13:12:20,943::task::579::TaskManager.Task::(_updateState) Task=`f37a773c-60b7-4f8b-861e-f151e9f10aac`::moving from state init -> state preparing >Thread-73::INFO::2013-12-12 13:12:20,944::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-73::INFO::2013-12-12 13:12:20,944::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-73::DEBUG::2013-12-12 13:12:20,944::task::1168::TaskManager.Task::(prepare) Task=`f37a773c-60b7-4f8b-861e-f151e9f10aac`::finished: {} >Thread-73::DEBUG::2013-12-12 13:12:20,944::task::579::TaskManager.Task::(_updateState) Task=`f37a773c-60b7-4f8b-861e-f151e9f10aac`::moving from state preparing -> state finished >Thread-73::DEBUG::2013-12-12 13:12:20,944::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2013-12-12 13:12:20,944::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2013-12-12 13:12:20,945::task::974::TaskManager.Task::(_decref) Task=`f37a773c-60b7-4f8b-861e-f151e9f10aac`::ref 0 aborting False >Thread-72::DEBUG::2013-12-12 13:12:21,041::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '710d037b-f0d7-4460-b13c-cea331ee8ac9', 'bricks': ['latest-a:/bricks/201312121310559151942637805', 'latest-a:/bricks/20131212131056815850249563', 'latest-a:/bricks/201312121310568151245056192', 'latest-b:/bricks/20131212131056815550199115', 'latest-b:/bricks/20131212131056815516730110', 'latest-b:/bricks/201312121310568161287551485', 'latest-b:/bricks/20131212131115583927299489', 'latest-a:/bricks/20131212131123545341374234', 'latest-b:/bricks/20131212131131033219930446', 'latest-a:/bricks/201312121311391031151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-76::DEBUG::2013-12-12 13:12:26,066::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-76::DEBUG::2013-12-12 13:12:26,393::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-77::DEBUG::2013-12-12 13:12:26,401::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-77::DEBUG::2013-12-12 13:12:26,566::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '710d037b-f0d7-4460-b13c-cea331ee8ac9', 'bricks': ['latest-a:/bricks/201312121310559151942637805', 'latest-a:/bricks/20131212131056815850249563', 'latest-a:/bricks/201312121310568151245056192', 'latest-b:/bricks/20131212131056815550199115', 'latest-b:/bricks/20131212131056815516730110', 'latest-b:/bricks/201312121310568161287551485', 'latest-b:/bricks/20131212131115583927299489', 'latest-a:/bricks/20131212131123545341374234', 'latest-b:/bricks/20131212131131033219930446', 'latest-a:/bricks/201312121311391031151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-80::DEBUG::2013-12-12 13:12:31,587::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-80::DEBUG::2013-12-12 13:12:31,913::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-81::DEBUG::2013-12-12 13:12:31,922::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-81::DEBUG::2013-12-12 13:12:32,088::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '710d037b-f0d7-4460-b13c-cea331ee8ac9', 'bricks': ['latest-a:/bricks/201312121310559151942637805', 'latest-a:/bricks/20131212131056815850249563', 'latest-a:/bricks/201312121310568151245056192', 'latest-b:/bricks/20131212131056815550199115', 'latest-b:/bricks/20131212131056815516730110', 'latest-b:/bricks/201312121310568161287551485', 'latest-b:/bricks/20131212131115583927299489', 'latest-a:/bricks/20131212131123545341374234', 'latest-b:/bricks/20131212131131033219930446', 'latest-a:/bricks/201312121311391031151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-83::DEBUG::2013-12-12 13:12:36,038::task::579::TaskManager.Task::(_updateState) Task=`2ee3efda-43be-4af9-a768-9a451425480c`::moving from state init -> state preparing >Thread-83::INFO::2013-12-12 13:12:36,039::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-83::INFO::2013-12-12 13:12:36,039::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-83::DEBUG::2013-12-12 13:12:36,039::task::1168::TaskManager.Task::(prepare) Task=`2ee3efda-43be-4af9-a768-9a451425480c`::finished: {} >Thread-83::DEBUG::2013-12-12 13:12:36,039::task::579::TaskManager.Task::(_updateState) Task=`2ee3efda-43be-4af9-a768-9a451425480c`::moving from state preparing -> state finished >Thread-83::DEBUG::2013-12-12 13:12:36,039::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-83::DEBUG::2013-12-12 13:12:36,039::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-83::DEBUG::2013-12-12 13:12:36,040::task::974::TaskManager.Task::(_decref) Task=`2ee3efda-43be-4af9-a768-9a451425480c`::ref 0 aborting False >Thread-85::DEBUG::2013-12-12 13:12:37,108::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-85::DEBUG::2013-12-12 13:12:37,434::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-86::DEBUG::2013-12-12 13:12:37,441::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-86::DEBUG::2013-12-12 13:12:37,606::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '710d037b-f0d7-4460-b13c-cea331ee8ac9', 'bricks': ['latest-a:/bricks/201312121310559151942637805', 'latest-a:/bricks/20131212131056815850249563', 'latest-a:/bricks/201312121310568151245056192', 'latest-b:/bricks/20131212131056815550199115', 'latest-b:/bricks/20131212131056815516730110', 'latest-b:/bricks/201312121310568161287551485', 'latest-b:/bricks/20131212131115583927299489', 'latest-a:/bricks/20131212131123545341374234', 'latest-b:/bricks/20131212131131033219930446', 'latest-a:/bricks/201312121311391031151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-91::DEBUG::2013-12-12 13:12:51,118::task::579::TaskManager.Task::(_updateState) Task=`adcb1c77-df4c-49a1-ba4c-528272be8f59`::moving from state init -> state preparing >Thread-91::INFO::2013-12-12 13:12:51,118::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-91::INFO::2013-12-12 13:12:51,118::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-91::DEBUG::2013-12-12 13:12:51,119::task::1168::TaskManager.Task::(prepare) Task=`adcb1c77-df4c-49a1-ba4c-528272be8f59`::finished: {} >Thread-91::DEBUG::2013-12-12 13:12:51,119::task::579::TaskManager.Task::(_updateState) Task=`adcb1c77-df4c-49a1-ba4c-528272be8f59`::moving from state preparing -> state finished >Thread-91::DEBUG::2013-12-12 13:12:51,119::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-91::DEBUG::2013-12-12 13:12:51,119::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-91::DEBUG::2013-12-12 13:12:51,119::task::974::TaskManager.Task::(_decref) Task=`adcb1c77-df4c-49a1-ba4c-528272be8f59`::ref 0 aborting False >Thread-93::DEBUG::2013-12-12 13:12:53,676::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-93::DEBUG::2013-12-12 13:12:54,006::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-94::DEBUG::2013-12-12 13:12:54,014::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-94::DEBUG::2013-12-12 13:12:54,182::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '710d037b-f0d7-4460-b13c-cea331ee8ac9', 'bricks': ['latest-a:/bricks/201312121310559151942637805', 'latest-a:/bricks/20131212131056815850249563', 'latest-a:/bricks/201312121310568151245056192', 'latest-b:/bricks/20131212131056815550199115', 'latest-b:/bricks/20131212131056815516730110', 'latest-b:/bricks/201312121310568161287551485', 'latest-b:/bricks/20131212131115583927299489', 'latest-a:/bricks/20131212131123545341374234', 'latest-b:/bricks/20131212131131033219930446', 'latest-a:/bricks/201312121311391031151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-97::DEBUG::2013-12-12 13:12:59,270::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-97::DEBUG::2013-12-12 13:12:59,604::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-98::DEBUG::2013-12-12 13:12:59,612::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-98::DEBUG::2013-12-12 13:12:59,783::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '710d037b-f0d7-4460-b13c-cea331ee8ac9', 'bricks': ['latest-a:/bricks/201312121310559151942637805', 'latest-a:/bricks/20131212131056815850249563', 'latest-a:/bricks/201312121310568151245056192', 'latest-b:/bricks/20131212131056815550199115', 'latest-b:/bricks/20131212131056815516730110', 'latest-b:/bricks/201312121310568161287551485', 'latest-b:/bricks/20131212131115583927299489', 'latest-a:/bricks/20131212131123545341374234', 'latest-b:/bricks/20131212131131033219930446', 'latest-a:/bricks/201312121311391031151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-101::DEBUG::2013-12-12 13:13:03,650::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-101::DEBUG::2013-12-12 13:13:03,826::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-102::DEBUG::2013-12-12 13:13:04,804::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-102::DEBUG::2013-12-12 13:13:05,134::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-103::DEBUG::2013-12-12 13:13:05,142::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-103::DEBUG::2013-12-12 13:13:05,310::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '710d037b-f0d7-4460-b13c-cea331ee8ac9', 'bricks': ['latest-a:/bricks/201312121310559151942637805', 'latest-a:/bricks/20131212131056815850249563', 'latest-a:/bricks/201312121310568151245056192', 'latest-b:/bricks/20131212131056815550199115', 'latest-b:/bricks/20131212131056815516730110', 'latest-b:/bricks/201312121310568161287551485', 'latest-b:/bricks/20131212131115583927299489', 'latest-a:/bricks/20131212131123545341374234', 'latest-b:/bricks/20131212131131033219930446', 'latest-a:/bricks/201312121311391031151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-104::DEBUG::2013-12-12 13:13:06,208::task::579::TaskManager.Task::(_updateState) Task=`372c9fe7-3d4a-42b6-8091-c42513288888`::moving from state init -> state preparing >Thread-104::INFO::2013-12-12 13:13:06,208::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-104::INFO::2013-12-12 13:13:06,208::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-104::DEBUG::2013-12-12 13:13:06,208::task::1168::TaskManager.Task::(prepare) Task=`372c9fe7-3d4a-42b6-8091-c42513288888`::finished: {} >Thread-104::DEBUG::2013-12-12 13:13:06,208::task::579::TaskManager.Task::(_updateState) Task=`372c9fe7-3d4a-42b6-8091-c42513288888`::moving from state preparing -> state finished >Thread-104::DEBUG::2013-12-12 13:13:06,209::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-104::DEBUG::2013-12-12 13:13:06,209::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-104::DEBUG::2013-12-12 13:13:06,209::task::974::TaskManager.Task::(_decref) Task=`372c9fe7-3d4a-42b6-8091-c42513288888`::ref 0 aborting False >Thread-110::DEBUG::2013-12-12 13:13:21,294::task::579::TaskManager.Task::(_updateState) Task=`e21bf5cc-cf3c-4965-a351-48f8d382b82c`::moving from state init -> state preparing >Thread-110::INFO::2013-12-12 13:13:21,294::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-110::INFO::2013-12-12 13:13:21,294::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-110::DEBUG::2013-12-12 13:13:21,295::task::1168::TaskManager.Task::(prepare) Task=`e21bf5cc-cf3c-4965-a351-48f8d382b82c`::finished: {} >Thread-110::DEBUG::2013-12-12 13:13:21,295::task::579::TaskManager.Task::(_updateState) Task=`e21bf5cc-cf3c-4965-a351-48f8d382b82c`::moving from state preparing -> state finished >Thread-110::DEBUG::2013-12-12 13:13:21,295::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-110::DEBUG::2013-12-12 13:13:21,295::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-110::DEBUG::2013-12-12 13:13:21,295::task::974::TaskManager.Task::(_decref) Task=`e21bf5cc-cf3c-4965-a351-48f8d382b82c`::ref 0 aborting False >Thread-112::DEBUG::2013-12-12 13:13:21,372::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-112::DEBUG::2013-12-12 13:13:21,699::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-113::DEBUG::2013-12-12 13:13:21,706::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-113::DEBUG::2013-12-12 13:13:21,870::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '710d037b-f0d7-4460-b13c-cea331ee8ac9', 'bricks': ['latest-a:/bricks/201312121310559151942637805', 'latest-a:/bricks/20131212131056815850249563', 'latest-a:/bricks/201312121310568151245056192', 'latest-b:/bricks/20131212131056815550199115', 'latest-b:/bricks/20131212131056815516730110', 'latest-b:/bricks/201312121310568161287551485', 'latest-b:/bricks/20131212131115583927299489', 'latest-a:/bricks/20131212131123545341374234', 'latest-b:/bricks/20131212131131033219930446', 'latest-a:/bricks/201312121311391031151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-118::DEBUG::2013-12-12 13:13:36,447::task::579::TaskManager.Task::(_updateState) Task=`453bb126-3ccb-4489-9596-49f90ada05ae`::moving from state init -> state preparing >Thread-118::INFO::2013-12-12 13:13:36,447::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-118::INFO::2013-12-12 13:13:36,447::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-118::DEBUG::2013-12-12 13:13:36,447::task::1168::TaskManager.Task::(prepare) Task=`453bb126-3ccb-4489-9596-49f90ada05ae`::finished: {} >Thread-118::DEBUG::2013-12-12 13:13:36,447::task::579::TaskManager.Task::(_updateState) Task=`453bb126-3ccb-4489-9596-49f90ada05ae`::moving from state preparing -> state finished >Thread-118::DEBUG::2013-12-12 13:13:36,448::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-118::DEBUG::2013-12-12 13:13:36,448::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-118::DEBUG::2013-12-12 13:13:36,448::task::974::TaskManager.Task::(_decref) Task=`453bb126-3ccb-4489-9596-49f90ada05ae`::ref 0 aborting False >Thread-122::DEBUG::2013-12-12 13:13:43,483::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-122::DEBUG::2013-12-12 13:13:43,811::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-123::DEBUG::2013-12-12 13:13:43,819::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-123::DEBUG::2013-12-12 13:13:43,987::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '710d037b-f0d7-4460-b13c-cea331ee8ac9', 'bricks': ['latest-a:/bricks/201312121310559151942637805', 'latest-a:/bricks/20131212131056815850249563', 'latest-a:/bricks/201312121310568151245056192', 'latest-b:/bricks/20131212131056815550199115', 'latest-b:/bricks/20131212131056815516730110', 'latest-b:/bricks/201312121310568161287551485', 'latest-b:/bricks/20131212131115583927299489', 'latest-a:/bricks/20131212131123545341374234', 'latest-b:/bricks/20131212131131033219930446', 'latest-a:/bricks/201312121311391031151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-126::DEBUG::2013-12-12 13:13:51,548::task::579::TaskManager.Task::(_updateState) Task=`f94a0c8b-b1d9-43b9-96ed-1612d6ac70c0`::moving from state init -> state preparing >Thread-126::INFO::2013-12-12 13:13:51,549::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-126::INFO::2013-12-12 13:13:51,549::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-126::DEBUG::2013-12-12 13:13:51,549::task::1168::TaskManager.Task::(prepare) Task=`f94a0c8b-b1d9-43b9-96ed-1612d6ac70c0`::finished: {} >Thread-126::DEBUG::2013-12-12 13:13:51,549::task::579::TaskManager.Task::(_updateState) Task=`f94a0c8b-b1d9-43b9-96ed-1612d6ac70c0`::moving from state preparing -> state finished >Thread-126::DEBUG::2013-12-12 13:13:51,549::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-126::DEBUG::2013-12-12 13:13:51,550::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-126::DEBUG::2013-12-12 13:13:51,550::task::974::TaskManager.Task::(_decref) Task=`f94a0c8b-b1d9-43b9-96ed-1612d6ac70c0`::ref 0 aborting False >Thread-128::DEBUG::2013-12-12 13:13:54,052::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-128::DEBUG::2013-12-12 13:13:54,379::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-129::DEBUG::2013-12-12 13:13:54,386::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-129::DEBUG::2013-12-12 13:13:54,551::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '710d037b-f0d7-4460-b13c-cea331ee8ac9', 'bricks': ['latest-a:/bricks/201312121310559151942637805', 'latest-a:/bricks/20131212131056815850249563', 'latest-a:/bricks/201312121310568151245056192', 'latest-b:/bricks/20131212131056815550199115', 'latest-b:/bricks/20131212131056815516730110', 'latest-b:/bricks/201312121310568161287551485', 'latest-b:/bricks/20131212131115583927299489', 'latest-a:/bricks/20131212131123545341374234', 'latest-b:/bricks/20131212131131033219930446', 'latest-a:/bricks/201312121311391031151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {}}}} >Thread-132::DEBUG::2013-12-12 13:13:59,570::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-132::DEBUG::2013-12-12 13:13:59,902::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-133::DEBUG::2013-12-12 13:13:59,910::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-133::DEBUG::2013-12-12 13:14:00,078::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '710d037b-f0d7-4460-b13c-cea331ee8ac9', 'bricks': ['latest-a:/bricks/201312121310559151942637805', 'latest-a:/bricks/20131212131056815850249563', 'latest-a:/bricks/201312121310568151245056192', 'latest-b:/bricks/20131212131056815550199115', 'latest-b:/bricks/20131212131056815516730110', 'latest-b:/bricks/201312121310568161287551485', 'latest-b:/bricks/20131212131115583927299489', 'latest-a:/bricks/20131212131123545341374234', 'latest-b:/bricks/20131212131131033219930446', 'latest-a:/bricks/201312121311391031151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {}}}} >Thread-136::DEBUG::2013-12-12 13:14:03,836::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-136::ERROR::2013-12-12 13:14:04,007::BindingXMLRPC::1000::vds::(wrapper) vdsm exception occured >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 989, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 53, in wrapper > rv = func(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 295, in tasksList > status = self.svdsmProxy.glusterTasksList(taskIds) > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in glusterTasksList > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >GlusterCmdExecFailedException: Command execution failed >return code: 2 >Thread-137::DEBUG::2013-12-12 13:14:06,661::task::579::TaskManager.Task::(_updateState) Task=`a990acce-0f7b-4f50-99bd-e4598f00b07f`::moving from state init -> state preparing >Thread-137::INFO::2013-12-12 13:14:06,661::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137::INFO::2013-12-12 13:14:06,662::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-137::DEBUG::2013-12-12 13:14:06,662::task::1168::TaskManager.Task::(prepare) Task=`a990acce-0f7b-4f50-99bd-e4598f00b07f`::finished: {} >Thread-137::DEBUG::2013-12-12 13:14:06,662::task::579::TaskManager.Task::(_updateState) Task=`a990acce-0f7b-4f50-99bd-e4598f00b07f`::moving from state preparing -> state finished >Thread-137::DEBUG::2013-12-12 13:14:06,662::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137::DEBUG::2013-12-12 13:14:06,662::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137::DEBUG::2013-12-12 13:14:06,663::task::974::TaskManager.Task::(_decref) Task=`a990acce-0f7b-4f50-99bd-e4598f00b07f`::ref 0 aborting False >Thread-141::DEBUG::2013-12-12 13:14:13,332::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-141::DEBUG::2013-12-12 13:14:13,665::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '17277992-0ec5-4f41-9f13-3360571eee4e'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': '76102dca-bdfd-448b-a1cc-7a967cf84589'}]} >Thread-142::DEBUG::2013-12-12 13:14:13,673::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-142::DEBUG::2013-12-12 13:14:13,838::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '710d037b-f0d7-4460-b13c-cea331ee8ac9', 'bricks': ['latest-a:/bricks/201312121310559151942637805', 'latest-a:/bricks/20131212131056815850249563', 'latest-a:/bricks/201312121310568151245056192', 'latest-b:/bricks/20131212131056815550199115', 'latest-b:/bricks/20131212131056815516730110', 'latest-b:/bricks/201312121310568161287551485', 'latest-b:/bricks/20131212131115583927299489', 'latest-a:/bricks/20131212131123545341374234', 'latest-b:/bricks/20131212131131033219930446', 'latest-a:/bricks/201312121311391031151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-143::DEBUG::2013-12-12 13:14:14,411::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeRebalanceStart with ('StartMigrationDuringRebalanceTest', False, False) {} flowID [74b8d5e9] >Thread-143::ERROR::2013-12-12 13:14:19,863::BindingXMLRPC::1000::vds::(wrapper) vdsm exception occured >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 989, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 53, in wrapper > rv = func(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 125, in volumeRebalanceStart > force) > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in glusterVolumeRebalanceStart > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >GlusterCmdExecFailedException: Command execution failed >error: Connection failed. Please check if gluster daemon is operational. >return code: 1 >Thread-146::DEBUG::2013-12-12 13:14:21,787::task::579::TaskManager.Task::(_updateState) Task=`750b4e16-30bb-486e-9456-8e026d0db098`::moving from state init -> state preparing >Thread-146::INFO::2013-12-12 13:14:21,787::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-146::INFO::2013-12-12 13:14:21,788::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-146::DEBUG::2013-12-12 13:14:21,788::task::1168::TaskManager.Task::(prepare) Task=`750b4e16-30bb-486e-9456-8e026d0db098`::finished: {} >Thread-146::DEBUG::2013-12-12 13:14:21,788::task::579::TaskManager.Task::(_updateState) Task=`750b4e16-30bb-486e-9456-8e026d0db098`::moving from state preparing -> state finished >Thread-146::DEBUG::2013-12-12 13:14:21,788::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-146::DEBUG::2013-12-12 13:14:21,788::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-146::DEBUG::2013-12-12 13:14:21,788::task::974::TaskManager.Task::(_decref) Task=`750b4e16-30bb-486e-9456-8e026d0db098`::ref 0 aborting False >Thread-148::DEBUG::2013-12-12 13:14:24,383::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-148::ERROR::2013-12-12 13:14:27,405::BindingXMLRPC::1000::vds::(wrapper) vdsm exception occured >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 989, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 53, in wrapper > rv = func(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 229, in hostsList > return {'hosts': self.svdsmProxy.glusterPeerStatus()} > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in glusterPeerStatus > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >GlusterCmdExecFailedException: Command execution failed >error: Connection failed. Please check if gluster daemon is operational. >return code: 1 >Thread-151::DEBUG::2013-12-12 13:14:30,635::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} flowID [2b3d0564] >Thread-151::ERROR::2013-12-12 13:14:33,644::BindingXMLRPC::1000::vds::(wrapper) vdsm exception occured >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 989, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 53, in wrapper > rv = func(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 77, in volumesList > return {'volumes': self.svdsmProxy.glusterVolumeInfo(volumeName)} > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in glusterVolumeInfo > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >GlusterCmdExecFailedException: Command execution failed >error: Connection failed. Please check if gluster daemon is operational. >return code: 1 >Thread-154::DEBUG::2013-12-12 13:14:36,917::task::579::TaskManager.Task::(_updateState) Task=`f480eec7-9461-4e03-b076-4d137ecf1276`::moving from state init -> state preparing >Thread-154::INFO::2013-12-12 13:14:36,917::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-154::INFO::2013-12-12 13:14:36,918::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-154::DEBUG::2013-12-12 13:14:36,918::task::1168::TaskManager.Task::(prepare) Task=`f480eec7-9461-4e03-b076-4d137ecf1276`::finished: {} >Thread-154::DEBUG::2013-12-12 13:14:36,918::task::579::TaskManager.Task::(_updateState) Task=`f480eec7-9461-4e03-b076-4d137ecf1276`::moving from state preparing -> state finished >Thread-154::DEBUG::2013-12-12 13:14:36,918::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-154::DEBUG::2013-12-12 13:14:36,918::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-154::DEBUG::2013-12-12 13:14:36,918::task::974::TaskManager.Task::(_decref) Task=`f480eec7-9461-4e03-b076-4d137ecf1276`::ref 0 aborting False >Thread-160::DEBUG::2013-12-12 13:14:52,009::task::579::TaskManager.Task::(_updateState) Task=`7db23145-e38c-4477-9e72-f09de975e7b1`::moving from state init -> state preparing >Thread-160::INFO::2013-12-12 13:14:52,010::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-160::INFO::2013-12-12 13:14:52,010::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-160::DEBUG::2013-12-12 13:14:52,010::task::1168::TaskManager.Task::(prepare) Task=`7db23145-e38c-4477-9e72-f09de975e7b1`::finished: {} >Thread-160::DEBUG::2013-12-12 13:14:52,010::task::579::TaskManager.Task::(_updateState) Task=`7db23145-e38c-4477-9e72-f09de975e7b1`::moving from state preparing -> state finished >Thread-160::DEBUG::2013-12-12 13:14:52,010::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-160::DEBUG::2013-12-12 13:14:52,011::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-160::DEBUG::2013-12-12 13:14:52,011::task::974::TaskManager.Task::(_decref) Task=`7db23145-e38c-4477-9e72-f09de975e7b1`::ref 0 aborting False >Thread-165::DEBUG::2013-12-12 13:15:03,462::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getCapabilities with () {} flowID [10894266] >Thread-165::DEBUG::2013-12-12 13:15:03,462::utils::489::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-165::DEBUG::2013-12-12 13:15:03,467::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-165::DEBUG::2013-12-12 13:15:03,479::caps::363::root::(_getKeyPackages) rpm package glusterfs-rdma not found >Thread-165::DEBUG::2013-12-12 13:15:03,480::caps::363::root::(_getKeyPackages) rpm package glusterfs-fuse not found >Thread-165::DEBUG::2013-12-12 13:15:03,480::caps::363::root::(_getKeyPackages) rpm package gluster-swift not found >Thread-165::DEBUG::2013-12-12 13:15:03,481::caps::363::root::(_getKeyPackages) rpm package qemu-kvm-rhev not found >Thread-165::DEBUG::2013-12-12 13:15:03,482::caps::363::root::(_getKeyPackages) rpm package gluster-swift-object not found >Thread-165::DEBUG::2013-12-12 13:15:03,482::caps::363::root::(_getKeyPackages) rpm package glusterfs not found >Thread-165::DEBUG::2013-12-12 13:15:03,482::caps::363::root::(_getKeyPackages) rpm package gluster-swift-plugin not found >Thread-165::DEBUG::2013-12-12 13:15:03,483::caps::363::root::(_getKeyPackages) rpm package qemu-img-rhev not found >Thread-165::DEBUG::2013-12-12 13:15:03,484::caps::363::root::(_getKeyPackages) rpm package ('mom',) not found >Thread-165::DEBUG::2013-12-12 13:15:03,484::caps::363::root::(_getKeyPackages) rpm package gluster-swift-account not found >Thread-165::DEBUG::2013-12-12 13:15:03,484::caps::363::root::(_getKeyPackages) rpm package gluster-swift-proxy not found >Thread-165::DEBUG::2013-12-12 13:15:03,485::caps::363::root::(_getKeyPackages) rpm package gluster-swift-doc not found >Thread-165::DEBUG::2013-12-12 13:15:03,485::caps::363::root::(_getKeyPackages) rpm package glusterfs-server not found >Thread-165::DEBUG::2013-12-12 13:15:03,485::caps::363::root::(_getKeyPackages) rpm package gluster-swift-container not found >Thread-165::DEBUG::2013-12-12 13:15:03,485::caps::363::root::(_getKeyPackages) rpm package glusterfs-geo-replication not found >Thread-165::DEBUG::2013-12-12 13:15:03,486::BindingXMLRPC::991::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.28.1.el6.x86_64', 'buildtime': 1384533955.0, 'version': '2.6.32'}, 'vdsm': {'release': '23.1.el6rhs', 'buildtime': 1386773756L, 'version': '4.13.0'}, 'spice-server': {'release': '12.el6_4.5', 'buildtime': 1381834662L, 'version': '0.12.0'}, 'libvirt': {'release': '18.el6_4.13', 'buildtime': 1379320058L, 'version': '0.10.2'}}, 'cpuModel': 'QEMU Virtual CPU version 1.4.2', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.14.16.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.14.16.254', 'ports': ['eth0']}}, 'uuid': '7B904C94-94EE-7B49-40B3-BD3C28FBB749', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'netmask': '', 'addr': '', 'hwaddr': '52:54:00:b7:60:bc', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': '52:54:00:b7:60:bc', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 100, 'mtu': '1500'}}, 'software_revision': '23.1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': 'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,lm,up,rep_good,unfair_spinlock,pni,cx16,popcnt,hypervisor,lahf_lm', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '4062', 'cpuSpeed': '2393.998', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '1', 'kvmEnabled': 'false', 'rhsVersion': {'release': '1.el6rhs', 'version': '2.1.2.0', 'name': 'RHS'}, 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '1', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.14.16.112'}} >Thread-166::DEBUG::2013-12-12 13:15:03,498::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getHardwareInfo with () {} flowID [10894266] >Thread-166::DEBUG::2013-12-12 13:15:03,500::BindingXMLRPC::991::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'Bochs', 'systemSerialNumber': 'Not Specified', 'systemFamily': 'Not Specified', 'systemVersion': 'Not Specified', 'systemUUID': '7b904c94-94ee-7b49-40b3-bd3c28fbb749', 'systemManufacturer': 'Bochs'}} >Thread-167::DEBUG::2013-12-12 13:15:03,521::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} flowID [10894266] >Thread-167::ERROR::2013-12-12 13:15:06,530::BindingXMLRPC::1000::vds::(wrapper) vdsm exception occured >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 989, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 53, in wrapper > rv = func(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 229, in hostsList > return {'hosts': self.svdsmProxy.glusterPeerStatus()} > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in glusterPeerStatus > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >GlusterCmdExecFailedException: Command execution failed >error: Connection failed. Please check if gluster daemon is operational. >return code: 1 >Thread-169::DEBUG::2013-12-12 13:15:10,098::task::579::TaskManager.Task::(_updateState) Task=`c5deb0ae-2758-455a-8933-d16f4ec33f0b`::moving from state init -> state preparing >Thread-169::INFO::2013-12-12 13:15:10,098::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-169::INFO::2013-12-12 13:15:10,098::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-169::DEBUG::2013-12-12 13:15:10,098::task::1168::TaskManager.Task::(prepare) Task=`c5deb0ae-2758-455a-8933-d16f4ec33f0b`::finished: {} >Thread-169::DEBUG::2013-12-12 13:15:10,098::task::579::TaskManager.Task::(_updateState) Task=`c5deb0ae-2758-455a-8933-d16f4ec33f0b`::moving from state preparing -> state finished >Thread-169::DEBUG::2013-12-12 13:15:10,099::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-169::DEBUG::2013-12-12 13:15:10,099::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-169::DEBUG::2013-12-12 13:15:10,099::task::974::TaskManager.Task::(_decref) Task=`c5deb0ae-2758-455a-8933-d16f4ec33f0b`::ref 0 aborting False >Thread-175::DEBUG::2013-12-12 13:15:25,193::task::579::TaskManager.Task::(_updateState) Task=`dd08c0b4-381d-4680-9cb6-e0cfb21ca0b5`::moving from state init -> state preparing >Thread-175::INFO::2013-12-12 13:15:25,194::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-175::INFO::2013-12-12 13:15:25,194::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-175::DEBUG::2013-12-12 13:15:25,194::task::1168::TaskManager.Task::(prepare) Task=`dd08c0b4-381d-4680-9cb6-e0cfb21ca0b5`::finished: {} >Thread-175::DEBUG::2013-12-12 13:15:25,194::task::579::TaskManager.Task::(_updateState) Task=`dd08c0b4-381d-4680-9cb6-e0cfb21ca0b5`::moving from state preparing -> state finished >Thread-175::DEBUG::2013-12-12 13:15:25,194::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-175::DEBUG::2013-12-12 13:15:25,194::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-175::DEBUG::2013-12-12 13:15:25,195::task::974::TaskManager.Task::(_decref) Task=`dd08c0b4-381d-4680-9cb6-e0cfb21ca0b5`::ref 0 aborting False >Thread-181::DEBUG::2013-12-12 13:15:40,284::task::579::TaskManager.Task::(_updateState) Task=`33c84e9a-45f6-42f4-b588-7bc1d8e14daf`::moving from state init -> state preparing >Thread-181::INFO::2013-12-12 13:15:40,284::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-181::INFO::2013-12-12 13:15:40,285::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-181::DEBUG::2013-12-12 13:15:40,285::task::1168::TaskManager.Task::(prepare) Task=`33c84e9a-45f6-42f4-b588-7bc1d8e14daf`::finished: {} >Thread-181::DEBUG::2013-12-12 13:15:40,285::task::579::TaskManager.Task::(_updateState) Task=`33c84e9a-45f6-42f4-b588-7bc1d8e14daf`::moving from state preparing -> state finished >Thread-181::DEBUG::2013-12-12 13:15:40,285::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-181::DEBUG::2013-12-12 13:15:40,285::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-181::DEBUG::2013-12-12 13:15:40,285::task::974::TaskManager.Task::(_decref) Task=`33c84e9a-45f6-42f4-b588-7bc1d8e14daf`::ref 0 aborting False >MainThread::DEBUG::2013-12-12 13:15:46,918::vdsm::45::vds::(sigtermHandler) Received signal 15 >MainThread::INFO::2013-12-12 13:15:47,361::vmChannels::183::vds::(stop) VM channels listener was stopped. >MainThread::DEBUG::2013-12-12 13:15:47,361::task::579::TaskManager.Task::(_updateState) Task=`5ce56fbe-fb6c-42f3-b26b-059b0a65c445`::moving from state init -> state preparing >MainThread::INFO::2013-12-12 13:15:47,362::logUtils::44::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2013-12-12 13:15:47,397::storageServer::698::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::INFO::2013-12-12 13:15:47,637::domainMonitor::126::Storage.DomainMonitor::(close) Stopping domain monitors >MainThread::DEBUG::2013-12-12 13:15:47,638::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2013-12-12 13:15:47,638::logUtils::47::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2013-12-12 13:15:47,638::task::1168::TaskManager.Task::(prepare) Task=`5ce56fbe-fb6c-42f3-b26b-059b0a65c445`::finished: None >MainThread::DEBUG::2013-12-12 13:15:47,638::task::579::TaskManager.Task::(_updateState) Task=`5ce56fbe-fb6c-42f3-b26b-059b0a65c445`::moving from state preparing -> state finished >MainThread::DEBUG::2013-12-12 13:15:47,638::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-12-12 13:15:47,639::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-12-12 13:15:47,639::task::974::TaskManager.Task::(_decref) Task=`5ce56fbe-fb6c-42f3-b26b-059b0a65c445`::ref 0 aborting False >MainThread::INFO::2013-12-12 13:15:47,639::vdsm::107::vds::(run) VDSM main thread ended. Waiting for 13 other threads... >MainThread::INFO::2013-12-12 13:15:47,639::vdsm::111::vds::(run) <_MainThread(MainThread, started 139698339120896)> >MainThread::INFO::2013-12-12 13:15:47,639::vdsm::111::vds::(run) <Thread(libvirtEventLoop, started daemon 139698243749632)> >MainThread::INFO::2013-12-12 13:15:47,639::vdsm::111::vds::(run) <WorkerThread(Thread-6, started daemon 139698064307968)> >MainThread::INFO::2013-12-12 13:15:47,640::vdsm::111::vds::(run) <WorkerThread(Thread-9, started daemon 139697626015488)> >MainThread::INFO::2013-12-12 13:15:47,640::vdsm::111::vds::(run) <WorkerThread(Thread-5, started daemon 139698074797824)> >MainThread::INFO::2013-12-12 13:15:47,640::vdsm::111::vds::(run) <WorkerThread(Thread-1, started daemon 139698186221312)> >MainThread::INFO::2013-12-12 13:15:47,640::vdsm::111::vds::(run) <WorkerThread(Thread-7, started daemon 139698053818112)> >MainThread::INFO::2013-12-12 13:15:47,640::vdsm::111::vds::(run) <WorkerThread(Thread-3, started daemon 139698095777536)> >MainThread::INFO::2013-12-12 13:15:47,640::vdsm::111::vds::(run) <KsmMonitorThread(KsmMonitor, started daemon 139697502287616)> >MainThread::INFO::2013-12-12 13:15:47,640::vdsm::111::vds::(run) <WorkerThread(Thread-2, started daemon 139698106267392)> >MainThread::INFO::2013-12-12 13:15:47,641::vdsm::111::vds::(run) <WorkerThread(Thread-8, started daemon 139697636505344)> >MainThread::INFO::2013-12-12 13:15:47,641::vmChannels::183::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2013-12-12 13:15:47,641::vdsm::111::vds::(run) <Listener(VM Channels Listener, started daemon 139697481307904)> >MainThread::INFO::2013-12-12 13:15:47,641::vdsm::111::vds::(run) <WorkerThread(Thread-10, started daemon 139697615525632)> >MainThread::INFO::2013-12-12 13:15:47,641::vdsm::111::vds::(run) <WorkerThread(Thread-4, started daemon 139698085287680)> >MainThread::INFO::2013-12-12 13:16:21,903::vdsm::101::vds::(run) (PID: 2712) I am the actual vdsm 4.13.0-23.1.el6rhs rhs-21u2-20131208-b (2.6.32-358.28.1.el6.x86_64) >MainThread::DEBUG::2013-12-12 13:16:22,129::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2013-12-12 13:16:22,129::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2013-12-12 13:16:22,135::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2013-12-12 13:16:22,419::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::INFO::2013-12-12 13:16:22,432::multipath::134::Storage.Multipath::(isEnabled) Manual override for multipath.conf detected - preserving current configuration >MainThread::WARNING::2013-12-12 13:16:22,432::multipath::137::Storage.Multipath::(isEnabled) This manual override for multipath.conf was based on downrevved template. You are strongly advised to contact your support representatives >MainThread::DEBUG::2013-12-12 13:16:22,433::hsm::426::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2013-12-12 13:16:22,476::hsm::426::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-12-12 13:16:22,477::hsm::450::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2013-12-12 13:16:22,479::hsm::482::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2013-12-12 13:16:22,479::hsm::483::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2013-12-12 13:16:22,479::hsm::485::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2013-12-12 13:16:22,480::hsm::528::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2013-12-12 13:16:22,481::dispatcher::98::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >MainThread::DEBUG::2013-12-12 13:16:22,482::task::579::TaskManager.Task::(_updateState) Task=`2c2894a7-6170-45f7-9c55-e67830eff5ec`::moving from state init -> state preparing >MainThread::INFO::2013-12-12 13:16:22,482::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0x7fde97d9a200>>) >MainThread::INFO::2013-12-12 13:16:22,482::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None >MainThread::DEBUG::2013-12-12 13:16:22,482::task::1168::TaskManager.Task::(prepare) Task=`2c2894a7-6170-45f7-9c55-e67830eff5ec`::finished: None >MainThread::DEBUG::2013-12-12 13:16:22,483::task::579::TaskManager.Task::(_updateState) Task=`2c2894a7-6170-45f7-9c55-e67830eff5ec`::moving from state preparing -> state finished >MainThread::DEBUG::2013-12-12 13:16:22,483::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-12-12 13:16:22,483::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-12-12 13:16:22,483::task::974::TaskManager.Task::(_decref) Task=`2c2894a7-6170-45f7-9c55-e67830eff5ec`::ref 0 aborting False >storageRefresh::DEBUG::2013-12-12 13:16:22,488::lvm::338::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 13:16:22,489::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::WARNING::2013-12-12 13:16:22,499::clientIF::196::vds::(_prepareMOM) MOM is not available, fallback to KsmMonitor >MainThread::DEBUG::2013-12-12 13:16:22,500::utils::489::root::(execCmd) '/usr/bin/pgrep -xf ksmd' (cwd None) >MainThread::DEBUG::2013-12-12 13:16:22,527::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2013-12-12 13:16:22,527::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 29 >storageRefresh::DEBUG::2013-12-12 13:16:22,551::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 13:16:22,551::lvm::363::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 13:16:22,552::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 13:16:22,552::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >KsmMonitor::DEBUG::2013-12-12 13:16:22,561::utils::489::root::(execCmd) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2013-12-12 13:16:22,570::vmChannels::187::vds::(settimeout) Setting channels' timeout to 30 seconds. >clientIFinit::DEBUG::2013-12-12 13:16:22,570::libvirtconnection::131::libvirtconnection::(get) trying to connect libvirt >storageRefresh::DEBUG::2013-12-12 13:16:22,604::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 13:16:22,604::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 13:16:22,605::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >VM Channels Listener::INFO::2013-12-12 13:16:22,619::vmChannels::170::vds::(run) Starting VM channels listener thread. >storageRefresh::DEBUG::2013-12-12 13:16:22,646::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 13:16:22,646::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 13:16:22,647::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >storageRefresh::DEBUG::2013-12-12 13:16:22,694::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 13:16:22,695::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 13:16:22,695::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >storageRefresh::DEBUG::2013-12-12 13:16:22,695::misc::811::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-12-12 13:16:22,695::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2013-12-12 13:16:22,695::misc::811::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-12-12 13:16:22,696::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2013-12-12 13:16:22,733::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >storageRefresh::DEBUG::2013-12-12 13:16:22,733::misc::819::SamplingMethod::(__call__) Returning last result >storageRefresh::DEBUG::2013-12-12 13:16:26,764::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >storageRefresh::DEBUG::2013-12-12 13:16:26,817::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 13:16:26,818::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 13:16:26,818::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 13:16:26,818::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 13:16:26,818::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 13:16:26,819::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 13:16:26,819::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 13:16:26,819::misc::819::SamplingMethod::(__call__) Returning last result >storageRefresh::WARNING::2013-12-12 13:16:26,819::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >KsmMonitor::DEBUG::2013-12-12 13:16:28,765::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2013-12-12 13:16:28,765::utils::489::root::(execCmd) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2013-12-12 13:16:28,812::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-12-12 13:33:35,413::vdsm::45::vds::(sigtermHandler) Received signal 15 >MainThread::INFO::2013-12-12 13:33:35,424::vmChannels::183::vds::(stop) VM channels listener was stopped. >MainThread::DEBUG::2013-12-12 13:33:35,425::task::579::TaskManager.Task::(_updateState) Task=`206726fc-cd82-4589-ba5b-ed96491a9d91`::moving from state init -> state preparing >MainThread::INFO::2013-12-12 13:33:35,425::logUtils::44::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2013-12-12 13:33:35,447::storageServer::698::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::INFO::2013-12-12 13:33:35,693::domainMonitor::126::Storage.DomainMonitor::(close) Stopping domain monitors >MainThread::DEBUG::2013-12-12 13:33:35,693::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2013-12-12 13:33:35,693::logUtils::47::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2013-12-12 13:33:35,693::task::1168::TaskManager.Task::(prepare) Task=`206726fc-cd82-4589-ba5b-ed96491a9d91`::finished: None >MainThread::DEBUG::2013-12-12 13:33:35,693::task::579::TaskManager.Task::(_updateState) Task=`206726fc-cd82-4589-ba5b-ed96491a9d91`::moving from state preparing -> state finished >MainThread::DEBUG::2013-12-12 13:33:35,694::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-12-12 13:33:35,694::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-12-12 13:33:35,694::task::974::TaskManager.Task::(_decref) Task=`206726fc-cd82-4589-ba5b-ed96491a9d91`::ref 0 aborting False >MainThread::INFO::2013-12-12 13:33:35,694::vdsm::107::vds::(run) VDSM main thread ended. Waiting for 13 other threads... >MainThread::INFO::2013-12-12 13:33:35,694::vdsm::111::vds::(run) <_MainThread(MainThread, started 140594036360960)> >MainThread::INFO::2013-12-12 13:33:35,694::vdsm::111::vds::(run) <Thread(libvirtEventLoop, started daemon 140593941788416)> >MainThread::INFO::2013-12-12 13:33:35,695::vdsm::111::vds::(run) <WorkerThread(Thread-5, started daemon 140593766315776)> >MainThread::INFO::2013-12-12 13:33:35,695::vdsm::111::vds::(run) <WorkerThread(Thread-8, started daemon 140593395132160)> >MainThread::INFO::2013-12-12 13:33:35,695::vdsm::111::vds::(run) <WorkerThread(Thread-10, started daemon 140593374152448)> >MainThread::INFO::2013-12-12 13:33:35,695::vmChannels::183::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2013-12-12 13:33:35,695::vdsm::111::vds::(run) <Listener(VM Channels Listener, started daemon 140593172825856)> >MainThread::INFO::2013-12-12 13:33:35,695::vdsm::111::vds::(run) <WorkerThread(Thread-3, started daemon 140593787295488)> >MainThread::INFO::2013-12-12 13:33:35,696::vdsm::111::vds::(run) <WorkerThread(Thread-6, started daemon 140593755825920)> >MainThread::INFO::2013-12-12 13:33:35,696::vdsm::111::vds::(run) <WorkerThread(Thread-2, started daemon 140593797785344)> >MainThread::INFO::2013-12-12 13:33:35,696::vdsm::111::vds::(run) <WorkerThread(Thread-1, started daemon 140593808275200)> >MainThread::INFO::2013-12-12 13:33:35,696::vdsm::111::vds::(run) <KsmMonitorThread(KsmMonitor, started daemon 140593193805568)> >MainThread::INFO::2013-12-12 13:33:35,696::vdsm::111::vds::(run) <WorkerThread(Thread-9, started daemon 140593384642304)> >MainThread::INFO::2013-12-12 13:33:35,696::vdsm::111::vds::(run) <WorkerThread(Thread-7, started daemon 140593405622016)> >MainThread::INFO::2013-12-12 13:33:35,696::vdsm::111::vds::(run) <WorkerThread(Thread-4, started daemon 140593776805632)> >MainThread::INFO::2013-12-12 13:33:47,545::vdsm::101::vds::(run) (PID: 4761) I am the actual vdsm 4.13.0-23.1.el6rhs rhs-21u2-20131208-b (2.6.32-358.28.1.el6.x86_64) >MainThread::DEBUG::2013-12-12 13:33:47,791::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2013-12-12 13:33:47,791::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2013-12-12 13:33:47,796::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2013-12-12 13:33:48,312::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::INFO::2013-12-12 13:33:48,329::multipath::134::Storage.Multipath::(isEnabled) Manual override for multipath.conf detected - preserving current configuration >MainThread::WARNING::2013-12-12 13:33:48,329::multipath::137::Storage.Multipath::(isEnabled) This manual override for multipath.conf was based on downrevved template. You are strongly advised to contact your support representatives >MainThread::DEBUG::2013-12-12 13:33:48,329::hsm::426::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2013-12-12 13:33:48,364::hsm::426::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2013-12-12 13:33:48,365::hsm::450::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2013-12-12 13:33:48,367::hsm::482::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2013-12-12 13:33:48,367::hsm::483::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2013-12-12 13:33:48,367::hsm::485::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2013-12-12 13:33:48,368::hsm::528::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2013-12-12 13:33:48,370::dispatcher::98::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >MainThread::DEBUG::2013-12-12 13:33:48,370::task::579::TaskManager.Task::(_updateState) Task=`439ac42d-692d-48f4-8b7a-f735f9029b4c`::moving from state init -> state preparing >MainThread::INFO::2013-12-12 13:33:48,371::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0x7fda11d2a200>>) >MainThread::INFO::2013-12-12 13:33:48,371::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None >MainThread::DEBUG::2013-12-12 13:33:48,371::task::1168::TaskManager.Task::(prepare) Task=`439ac42d-692d-48f4-8b7a-f735f9029b4c`::finished: None >MainThread::DEBUG::2013-12-12 13:33:48,371::task::579::TaskManager.Task::(_updateState) Task=`439ac42d-692d-48f4-8b7a-f735f9029b4c`::moving from state preparing -> state finished >MainThread::DEBUG::2013-12-12 13:33:48,371::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2013-12-12 13:33:48,371::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2013-12-12 13:33:48,372::task::974::TaskManager.Task::(_decref) Task=`439ac42d-692d-48f4-8b7a-f735f9029b4c`::ref 0 aborting False >storageRefresh::DEBUG::2013-12-12 13:33:48,376::lvm::338::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 13:33:48,377::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >MainThread::WARNING::2013-12-12 13:33:48,385::clientIF::196::vds::(_prepareMOM) MOM is not available, fallback to KsmMonitor >MainThread::DEBUG::2013-12-12 13:33:48,386::utils::489::root::(execCmd) '/usr/bin/pgrep -xf ksmd' (cwd None) >MainThread::DEBUG::2013-12-12 13:33:48,419::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2013-12-12 13:33:48,420::ksm::43::vds::(__init__) starting ksm monitor thread, ksm pid is 29 >storageRefresh::DEBUG::2013-12-12 13:33:48,443::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 13:33:48,444::lvm::363::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 13:33:48,444::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 13:33:48,445::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >KsmMonitor::DEBUG::2013-12-12 13:33:48,453::utils::489::root::(execCmd) '/usr/bin/sudo -n /sbin/service ksmtuned start' (cwd None) >MainThread::INFO::2013-12-12 13:33:48,461::vmChannels::187::vds::(settimeout) Setting channels' timeout to 30 seconds. >clientIFinit::DEBUG::2013-12-12 13:33:48,462::libvirtconnection::131::libvirtconnection::(get) trying to connect libvirt >storageRefresh::DEBUG::2013-12-12 13:33:48,493::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 13:33:48,494::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 13:33:48,494::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >VM Channels Listener::INFO::2013-12-12 13:33:48,512::vmChannels::170::vds::(run) Starting VM channels listener thread. >storageRefresh::DEBUG::2013-12-12 13:33:48,548::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 13:33:48,549::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 13:33:48,549::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >storageRefresh::DEBUG::2013-12-12 13:33:48,592::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 13:33:48,593::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 13:33:48,593::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >storageRefresh::DEBUG::2013-12-12 13:33:48,593::misc::811::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-12-12 13:33:48,593::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2013-12-12 13:33:48,594::misc::811::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2013-12-12 13:33:48,594::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2013-12-12 13:33:48,633::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 >storageRefresh::DEBUG::2013-12-12 13:33:48,634::misc::819::SamplingMethod::(__call__) Returning last result >Thread-13::DEBUG::2013-12-12 13:33:49,219::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call ping with () {} flowID [28618466] >Thread-13::DEBUG::2013-12-12 13:33:49,219::BindingXMLRPC::991::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-14::DEBUG::2013-12-12 13:33:49,227::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getCapabilities with () {} flowID [28618466] >Thread-14::DEBUG::2013-12-12 13:33:49,293::utils::489::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-14::DEBUG::2013-12-12 13:33:49,507::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2013-12-12 13:33:49,550::caps::363::root::(_getKeyPackages) rpm package glusterfs-rdma not found >Thread-14::DEBUG::2013-12-12 13:33:49,550::caps::363::root::(_getKeyPackages) rpm package glusterfs-fuse not found >Thread-14::DEBUG::2013-12-12 13:33:49,552::caps::363::root::(_getKeyPackages) rpm package gluster-swift not found >Thread-14::DEBUG::2013-12-12 13:33:49,552::caps::363::root::(_getKeyPackages) rpm package qemu-kvm-rhev not found >Thread-14::DEBUG::2013-12-12 13:33:49,553::caps::363::root::(_getKeyPackages) rpm package gluster-swift-object not found >Thread-14::DEBUG::2013-12-12 13:33:49,553::caps::363::root::(_getKeyPackages) rpm package glusterfs not found >Thread-14::DEBUG::2013-12-12 13:33:49,553::caps::363::root::(_getKeyPackages) rpm package gluster-swift-plugin not found >Thread-14::DEBUG::2013-12-12 13:33:49,554::caps::363::root::(_getKeyPackages) rpm package qemu-img-rhev not found >Thread-14::DEBUG::2013-12-12 13:33:49,555::caps::363::root::(_getKeyPackages) rpm package ('mom',) not found >Thread-14::DEBUG::2013-12-12 13:33:49,555::caps::363::root::(_getKeyPackages) rpm package gluster-swift-account not found >Thread-14::DEBUG::2013-12-12 13:33:49,555::caps::363::root::(_getKeyPackages) rpm package gluster-swift-proxy not found >Thread-14::DEBUG::2013-12-12 13:33:49,555::caps::363::root::(_getKeyPackages) rpm package gluster-swift-doc not found >Thread-14::DEBUG::2013-12-12 13:33:49,556::caps::363::root::(_getKeyPackages) rpm package glusterfs-server not found >Thread-14::DEBUG::2013-12-12 13:33:49,556::caps::363::root::(_getKeyPackages) rpm package gluster-swift-container not found >Thread-14::DEBUG::2013-12-12 13:33:49,556::caps::363::root::(_getKeyPackages) rpm package glusterfs-geo-replication not found >Thread-14::DEBUG::2013-12-12 13:33:49,560::BindingXMLRPC::991::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.28.1.el6.x86_64', 'buildtime': 1384533955.0, 'version': '2.6.32'}, 'vdsm': {'release': '23.1.el6rhs', 'buildtime': 1386773756L, 'version': '4.13.0'}, 'spice-server': {'release': '12.el6_4.5', 'buildtime': 1381834662L, 'version': '0.12.0'}, 'libvirt': {'release': '18.el6_4.13', 'buildtime': 1379320058L, 'version': '0.10.2'}}, 'cpuModel': 'QEMU Virtual CPU version 1.4.2', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.14.16.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.14.16.254', 'ports': ['eth0']}}, 'uuid': '7B904C94-94EE-7B49-40B3-BD3C28FBB749', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'netmask': '', 'addr': '', 'hwaddr': '52:54:00:b7:60:bc', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': '52:54:00:b7:60:bc', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 100, 'mtu': '1500'}}, 'software_revision': '23.1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': 'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,lm,up,rep_good,unfair_spinlock,pni,cx16,popcnt,hypervisor,lahf_lm', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '4062', 'cpuSpeed': '2393.998', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '1', 'kvmEnabled': 'false', 'rhsVersion': {'release': '1.el6rhs', 'version': '2.1.2.0', 'name': 'RHS'}, 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '1', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.14.16.112'}} >Thread-15::DEBUG::2013-12-12 13:33:50,049::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getCapabilities with () {} >Thread-15::DEBUG::2013-12-12 13:33:50,049::utils::489::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-15::DEBUG::2013-12-12 13:33:50,055::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2013-12-12 13:33:50,066::caps::363::root::(_getKeyPackages) rpm package glusterfs-rdma not found >Thread-15::DEBUG::2013-12-12 13:33:50,067::caps::363::root::(_getKeyPackages) rpm package glusterfs-fuse not found >Thread-15::DEBUG::2013-12-12 13:33:50,067::caps::363::root::(_getKeyPackages) rpm package gluster-swift not found >Thread-15::DEBUG::2013-12-12 13:33:50,068::caps::363::root::(_getKeyPackages) rpm package qemu-kvm-rhev not found >Thread-15::DEBUG::2013-12-12 13:33:50,068::caps::363::root::(_getKeyPackages) rpm package gluster-swift-object not found >Thread-15::DEBUG::2013-12-12 13:33:50,068::caps::363::root::(_getKeyPackages) rpm package glusterfs not found >Thread-15::DEBUG::2013-12-12 13:33:50,069::caps::363::root::(_getKeyPackages) rpm package gluster-swift-plugin not found >Thread-15::DEBUG::2013-12-12 13:33:50,070::caps::363::root::(_getKeyPackages) rpm package qemu-img-rhev not found >Thread-15::DEBUG::2013-12-12 13:33:50,070::caps::363::root::(_getKeyPackages) rpm package ('mom',) not found >Thread-15::DEBUG::2013-12-12 13:33:50,070::caps::363::root::(_getKeyPackages) rpm package gluster-swift-account not found >Thread-15::DEBUG::2013-12-12 13:33:50,071::caps::363::root::(_getKeyPackages) rpm package gluster-swift-proxy not found >Thread-15::DEBUG::2013-12-12 13:33:50,071::caps::363::root::(_getKeyPackages) rpm package gluster-swift-doc not found >Thread-15::DEBUG::2013-12-12 13:33:50,071::caps::363::root::(_getKeyPackages) rpm package glusterfs-server not found >Thread-15::DEBUG::2013-12-12 13:33:50,072::caps::363::root::(_getKeyPackages) rpm package gluster-swift-container not found >Thread-15::DEBUG::2013-12-12 13:33:50,072::caps::363::root::(_getKeyPackages) rpm package glusterfs-geo-replication not found >Thread-15::DEBUG::2013-12-12 13:33:50,073::BindingXMLRPC::991::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.28.1.el6.x86_64', 'buildtime': 1384533955.0, 'version': '2.6.32'}, 'vdsm': {'release': '23.1.el6rhs', 'buildtime': 1386773756L, 'version': '4.13.0'}, 'spice-server': {'release': '12.el6_4.5', 'buildtime': 1381834662L, 'version': '0.12.0'}, 'libvirt': {'release': '18.el6_4.13', 'buildtime': 1379320058L, 'version': '0.10.2'}}, 'cpuModel': 'QEMU Virtual CPU version 1.4.2', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.14.16.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.14.16.254', 'ports': ['eth0']}}, 'uuid': '7B904C94-94EE-7B49-40B3-BD3C28FBB749', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'netmask': '', 'addr': '', 'hwaddr': '52:54:00:b7:60:bc', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': '52:54:00:b7:60:bc', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 100, 'mtu': '1500'}}, 'software_revision': '23.1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': 'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,lm,up,rep_good,unfair_spinlock,pni,cx16,popcnt,hypervisor,lahf_lm', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '4062', 'cpuSpeed': '2393.998', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '1', 'kvmEnabled': 'false', 'rhsVersion': {'release': '1.el6rhs', 'version': '2.1.2.0', 'name': 'RHS'}, 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '1', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.14.16.112'}} >Thread-16::DEBUG::2013-12-12 13:33:50,114::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getHardwareInfo with () {} >Thread-16::DEBUG::2013-12-12 13:33:50,138::BindingXMLRPC::991::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'Bochs', 'systemSerialNumber': 'Not Specified', 'systemFamily': 'Not Specified', 'systemVersion': 'Not Specified', 'systemUUID': '7b904c94-94ee-7b49-40b3-bd3c28fbb749', 'systemManufacturer': 'Bochs'}} >Thread-17::DEBUG::2013-12-12 13:33:50,177::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-17::DEBUG::2013-12-12 13:33:50,592::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}]} >Thread-18::DEBUG::2013-12-12 13:33:50,600::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getCapabilities with () {} >Thread-18::DEBUG::2013-12-12 13:33:50,601::utils::489::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-18::DEBUG::2013-12-12 13:33:50,606::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2013-12-12 13:33:50,617::caps::363::root::(_getKeyPackages) rpm package glusterfs-rdma not found >Thread-18::DEBUG::2013-12-12 13:33:50,618::caps::363::root::(_getKeyPackages) rpm package glusterfs-fuse not found >Thread-18::DEBUG::2013-12-12 13:33:50,618::caps::363::root::(_getKeyPackages) rpm package gluster-swift not found >Thread-18::DEBUG::2013-12-12 13:33:50,619::caps::363::root::(_getKeyPackages) rpm package qemu-kvm-rhev not found >Thread-18::DEBUG::2013-12-12 13:33:50,619::caps::363::root::(_getKeyPackages) rpm package gluster-swift-object not found >Thread-18::DEBUG::2013-12-12 13:33:50,619::caps::363::root::(_getKeyPackages) rpm package glusterfs not found >Thread-18::DEBUG::2013-12-12 13:33:50,620::caps::363::root::(_getKeyPackages) rpm package gluster-swift-plugin not found >Thread-18::DEBUG::2013-12-12 13:33:50,621::caps::363::root::(_getKeyPackages) rpm package qemu-img-rhev not found >Thread-18::DEBUG::2013-12-12 13:33:50,621::caps::363::root::(_getKeyPackages) rpm package ('mom',) not found >Thread-18::DEBUG::2013-12-12 13:33:50,622::caps::363::root::(_getKeyPackages) rpm package gluster-swift-account not found >Thread-18::DEBUG::2013-12-12 13:33:50,622::caps::363::root::(_getKeyPackages) rpm package gluster-swift-proxy not found >Thread-18::DEBUG::2013-12-12 13:33:50,622::caps::363::root::(_getKeyPackages) rpm package gluster-swift-doc not found >Thread-18::DEBUG::2013-12-12 13:33:50,623::caps::363::root::(_getKeyPackages) rpm package glusterfs-server not found >Thread-18::DEBUG::2013-12-12 13:33:50,623::caps::363::root::(_getKeyPackages) rpm package gluster-swift-container not found >Thread-18::DEBUG::2013-12-12 13:33:50,623::caps::363::root::(_getKeyPackages) rpm package glusterfs-geo-replication not found >Thread-18::DEBUG::2013-12-12 13:33:50,624::BindingXMLRPC::991::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.28.1.el6.x86_64', 'buildtime': 1384533955.0, 'version': '2.6.32'}, 'vdsm': {'release': '23.1.el6rhs', 'buildtime': 1386773756L, 'version': '4.13.0'}, 'spice-server': {'release': '12.el6_4.5', 'buildtime': 1381834662L, 'version': '0.12.0'}, 'libvirt': {'release': '18.el6_4.13', 'buildtime': 1379320058L, 'version': '0.10.2'}}, 'cpuModel': 'QEMU Virtual CPU version 1.4.2', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.14.16.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.14.16.254', 'ports': ['eth0']}}, 'uuid': '7B904C94-94EE-7B49-40B3-BD3C28FBB749', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'netmask': '', 'addr': '', 'hwaddr': '52:54:00:b7:60:bc', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': '52:54:00:b7:60:bc', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 100, 'mtu': '1500'}}, 'software_revision': '23.1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': 'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,lm,up,rep_good,unfair_spinlock,pni,cx16,popcnt,hypervisor,lahf_lm', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '4062', 'cpuSpeed': '2393.998', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '1', 'kvmEnabled': 'false', 'rhsVersion': {'release': '1.el6rhs', 'version': '2.1.2.0', 'name': 'RHS'}, 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '1', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.14.16.112'}} >Thread-19::DEBUG::2013-12-12 13:33:50,646::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getHardwareInfo with () {} >Thread-19::DEBUG::2013-12-12 13:33:50,648::BindingXMLRPC::991::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'Bochs', 'systemSerialNumber': 'Not Specified', 'systemFamily': 'Not Specified', 'systemVersion': 'Not Specified', 'systemUUID': '7b904c94-94ee-7b49-40b3-bd3c28fbb749', 'systemManufacturer': 'Bochs'}} >Thread-20::DEBUG::2013-12-12 13:33:50,676::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-20::DEBUG::2013-12-12 13:33:51,016::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}]} >Thread-22::DEBUG::2013-12-12 13:33:51,092::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostUUIDGet with () {} flowID [73566704] >Thread-22::DEBUG::2013-12-12 13:33:51,258::BindingXMLRPC::991::vds::(wrapper) return hostUUIDGet with {'status': {'message': 'Done', 'code': 0}, 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'} >storageRefresh::DEBUG::2013-12-12 13:33:52,653::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >storageRefresh::DEBUG::2013-12-12 13:33:52,731::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2013-12-12 13:33:52,732::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 13:33:52,732::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 13:33:52,732::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 13:33:52,733::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 13:33:52,733::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2013-12-12 13:33:52,733::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2013-12-12 13:33:52,733::misc::819::SamplingMethod::(__call__) Returning last result >storageRefresh::WARNING::2013-12-12 13:33:52,734::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >KsmMonitor::DEBUG::2013-12-12 13:33:54,652::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >KsmMonitor::DEBUG::2013-12-12 13:33:54,652::utils::489::root::(execCmd) '/usr/bin/sudo -n /sbin/service ksm start' (cwd None) >KsmMonitor::DEBUG::2013-12-12 13:33:54,703::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-24::DEBUG::2013-12-12 13:33:57,424::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-24::DEBUG::2013-12-12 13:33:57,598::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-25::DEBUG::2013-12-12 13:33:58,914::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeCreate with ('StartMigrationDuringRebalanceTest', ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485'], 0, 0, ['TCP'], False) {} flowID [7eca50c9] >Thread-25::DEBUG::2013-12-12 13:34:02,828::BindingXMLRPC::991::vds::(wrapper) return volumeCreate with {'status': {'message': 'Done', 'code': 0}, 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e'} >Thread-28::DEBUG::2013-12-12 13:34:02,969::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-28::DEBUG::2013-12-12 13:34:03,297::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-29::DEBUG::2013-12-12 13:34:03,309::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-29::DEBUG::2013-12-12 13:34:03,475::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {}}}} >Thread-31::DEBUG::2013-12-12 13:34:08,324::task::579::TaskManager.Task::(_updateState) Task=`b3c4600f-3695-401e-a81d-4293bcd27dba`::moving from state init -> state preparing >Thread-31::INFO::2013-12-12 13:34:08,325::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-31::INFO::2013-12-12 13:34:08,325::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-31::DEBUG::2013-12-12 13:34:08,325::task::1168::TaskManager.Task::(prepare) Task=`b3c4600f-3695-401e-a81d-4293bcd27dba`::finished: {} >Thread-31::DEBUG::2013-12-12 13:34:08,325::task::579::TaskManager.Task::(_updateState) Task=`b3c4600f-3695-401e-a81d-4293bcd27dba`::moving from state preparing -> state finished >Thread-31::DEBUG::2013-12-12 13:34:08,325::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-31::DEBUG::2013-12-12 13:34:08,326::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-31::DEBUG::2013-12-12 13:34:08,326::task::974::TaskManager.Task::(_decref) Task=`b3c4600f-3695-401e-a81d-4293bcd27dba`::ref 0 aborting False >Thread-33::DEBUG::2013-12-12 13:34:09,866::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-33::DEBUG::2013-12-12 13:34:10,193::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-34::DEBUG::2013-12-12 13:34:10,203::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-34::DEBUG::2013-12-12 13:34:10,368::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '6', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-39::DEBUG::2013-12-12 13:34:23,608::task::579::TaskManager.Task::(_updateState) Task=`d72d0e41-d0cd-4554-98c1-77bc459e2cc5`::moving from state init -> state preparing >Thread-39::INFO::2013-12-12 13:34:23,609::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-39::INFO::2013-12-12 13:34:23,609::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-39::DEBUG::2013-12-12 13:34:23,609::task::1168::TaskManager.Task::(prepare) Task=`d72d0e41-d0cd-4554-98c1-77bc459e2cc5`::finished: {} >Thread-39::DEBUG::2013-12-12 13:34:23,609::task::579::TaskManager.Task::(_updateState) Task=`d72d0e41-d0cd-4554-98c1-77bc459e2cc5`::moving from state preparing -> state finished >Thread-39::DEBUG::2013-12-12 13:34:23,609::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-39::DEBUG::2013-12-12 13:34:23,610::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-39::DEBUG::2013-12-12 13:34:23,610::task::974::TaskManager.Task::(_decref) Task=`d72d0e41-d0cd-4554-98c1-77bc459e2cc5`::ref 0 aborting False >Thread-41::DEBUG::2013-12-12 13:34:26,485::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeBrickAdd with ('StartMigrationDuringRebalanceTest', ['latest-a:/bricks/20131212133427138341374234'], 0, 0, False) {} flowID [2160d901] >Thread-41::DEBUG::2013-12-12 13:34:32,981::BindingXMLRPC::991::vds::(wrapper) return volumeBrickAdd with {'status': {'message': 'Done', 'code': 0}} >Thread-45::DEBUG::2013-12-12 13:34:33,053::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-45::DEBUG::2013-12-12 13:34:33,390::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-46::DEBUG::2013-12-12 13:34:33,402::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-46::DEBUG::2013-12-12 13:34:33,567::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '8', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-48::DEBUG::2013-12-12 13:34:38,836::task::579::TaskManager.Task::(_updateState) Task=`8361ec00-a76d-4148-8f3e-4d2873813d1b`::moving from state init -> state preparing >Thread-48::INFO::2013-12-12 13:34:38,837::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-48::INFO::2013-12-12 13:34:38,837::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-48::DEBUG::2013-12-12 13:34:38,837::task::1168::TaskManager.Task::(prepare) Task=`8361ec00-a76d-4148-8f3e-4d2873813d1b`::finished: {} >Thread-48::DEBUG::2013-12-12 13:34:38,837::task::579::TaskManager.Task::(_updateState) Task=`8361ec00-a76d-4148-8f3e-4d2873813d1b`::moving from state preparing -> state finished >Thread-48::DEBUG::2013-12-12 13:34:38,837::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2013-12-12 13:34:38,838::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2013-12-12 13:34:38,838::task::974::TaskManager.Task::(_decref) Task=`8361ec00-a76d-4148-8f3e-4d2873813d1b`::ref 0 aborting False >Thread-51::DEBUG::2013-12-12 13:34:42,047::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-51::DEBUG::2013-12-12 13:34:42,495::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-52::DEBUG::2013-12-12 13:34:42,507::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-52::DEBUG::2013-12-12 13:34:42,671::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '9', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-53::DEBUG::2013-12-12 13:34:43,099::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeBrickAdd with ('StartMigrationDuringRebalanceTest', ['latest-a:/bricks/201312121334434851151947411'], 0, 0, False) {} flowID [492b2e51] >Thread-53::DEBUG::2013-12-12 13:34:50,373::BindingXMLRPC::991::vds::(wrapper) return volumeBrickAdd with {'status': {'message': 'Done', 'code': 0}} >Thread-57::DEBUG::2013-12-12 13:34:54,089::task::579::TaskManager.Task::(_updateState) Task=`33e28910-f968-445b-9e3c-fb18d5237678`::moving from state init -> state preparing >Thread-57::INFO::2013-12-12 13:34:54,089::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-57::INFO::2013-12-12 13:34:54,089::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-57::DEBUG::2013-12-12 13:34:54,089::task::1168::TaskManager.Task::(prepare) Task=`33e28910-f968-445b-9e3c-fb18d5237678`::finished: {} >Thread-57::DEBUG::2013-12-12 13:34:54,089::task::579::TaskManager.Task::(_updateState) Task=`33e28910-f968-445b-9e3c-fb18d5237678`::moving from state preparing -> state finished >Thread-57::DEBUG::2013-12-12 13:34:54,090::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2013-12-12 13:34:54,090::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2013-12-12 13:34:54,090::task::974::TaskManager.Task::(_decref) Task=`33e28910-f968-445b-9e3c-fb18d5237678`::ref 0 aborting False >Thread-59::DEBUG::2013-12-12 13:34:56,101::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-59::DEBUG::2013-12-12 13:34:56,430::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-60::DEBUG::2013-12-12 13:34:56,439::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-60::DEBUG::2013-12-12 13:34:56,610::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-62::DEBUG::2013-12-12 13:34:57,614::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-62::DEBUG::2013-12-12 13:34:57,787::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-64::DEBUG::2013-12-12 13:35:01,646::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-64::DEBUG::2013-12-12 13:35:01,974::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-65::DEBUG::2013-12-12 13:35:01,982::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-65::DEBUG::2013-12-12 13:35:02,152::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-68::DEBUG::2013-12-12 13:35:07,858::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeStop with ('StartMigrationDuringRebalanceTest', False) {} flowID [35f9eb6c] >Thread-69::DEBUG::2013-12-12 13:35:09,207::task::579::TaskManager.Task::(_updateState) Task=`7f19b26c-6a91-47c2-ba0b-6bfe21bd63f1`::moving from state init -> state preparing >Thread-69::INFO::2013-12-12 13:35:09,207::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-69::INFO::2013-12-12 13:35:09,207::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-69::DEBUG::2013-12-12 13:35:09,207::task::1168::TaskManager.Task::(prepare) Task=`7f19b26c-6a91-47c2-ba0b-6bfe21bd63f1`::finished: {} >Thread-69::DEBUG::2013-12-12 13:35:09,207::task::579::TaskManager.Task::(_updateState) Task=`7f19b26c-6a91-47c2-ba0b-6bfe21bd63f1`::moving from state preparing -> state finished >Thread-69::DEBUG::2013-12-12 13:35:09,208::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69::DEBUG::2013-12-12 13:35:09,208::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69::DEBUG::2013-12-12 13:35:09,208::task::974::TaskManager.Task::(_decref) Task=`7f19b26c-6a91-47c2-ba0b-6bfe21bd63f1`::ref 0 aborting False >Thread-68::DEBUG::2013-12-12 13:35:15,007::BindingXMLRPC::991::vds::(wrapper) return volumeStop with {'status': {'message': 'Done', 'code': 0}} >Thread-74::DEBUG::2013-12-12 13:35:20,687::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-74::DEBUG::2013-12-12 13:35:21,017::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-75::DEBUG::2013-12-12 13:35:21,028::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-75::DEBUG::2013-12-12 13:35:21,195::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'OFFLINE', 'stripeCount': '1', 'options': {}}}} >Thread-77::DEBUG::2013-12-12 13:35:23,390::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeStart with ('StartMigrationDuringRebalanceTest', False) {} flowID [e418061] >Thread-78::DEBUG::2013-12-12 13:35:24,372::task::579::TaskManager.Task::(_updateState) Task=`5906ccf2-9c28-43d4-b799-db74b4af796f`::moving from state init -> state preparing >Thread-78::INFO::2013-12-12 13:35:24,372::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-78::INFO::2013-12-12 13:35:24,373::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-78::DEBUG::2013-12-12 13:35:24,373::task::1168::TaskManager.Task::(prepare) Task=`5906ccf2-9c28-43d4-b799-db74b4af796f`::finished: {} >Thread-78::DEBUG::2013-12-12 13:35:24,373::task::579::TaskManager.Task::(_updateState) Task=`5906ccf2-9c28-43d4-b799-db74b4af796f`::moving from state preparing -> state finished >Thread-78::DEBUG::2013-12-12 13:35:24,373::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-78::DEBUG::2013-12-12 13:35:24,373::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-78::DEBUG::2013-12-12 13:35:24,373::task::974::TaskManager.Task::(_decref) Task=`5906ccf2-9c28-43d4-b799-db74b4af796f`::ref 0 aborting False >Thread-77::DEBUG::2013-12-12 13:35:29,172::BindingXMLRPC::991::vds::(wrapper) return volumeStart with {'status': {'message': 'Done', 'code': 0}} >Thread-83::DEBUG::2013-12-12 13:35:34,971::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-83::DEBUG::2013-12-12 13:35:35,299::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-84::DEBUG::2013-12-12 13:35:35,307::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-84::DEBUG::2013-12-12 13:35:35,472::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-86::DEBUG::2013-12-12 13:35:39,525::task::579::TaskManager.Task::(_updateState) Task=`c90f6637-f76d-4257-8520-23dd942b6050`::moving from state init -> state preparing >Thread-86::INFO::2013-12-12 13:35:39,526::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-86::INFO::2013-12-12 13:35:39,526::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-86::DEBUG::2013-12-12 13:35:39,526::task::1168::TaskManager.Task::(prepare) Task=`c90f6637-f76d-4257-8520-23dd942b6050`::finished: {} >Thread-86::DEBUG::2013-12-12 13:35:39,526::task::579::TaskManager.Task::(_updateState) Task=`c90f6637-f76d-4257-8520-23dd942b6050`::moving from state preparing -> state finished >Thread-86::DEBUG::2013-12-12 13:35:39,526::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-86::DEBUG::2013-12-12 13:35:39,526::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-86::DEBUG::2013-12-12 13:35:39,527::task::974::TaskManager.Task::(_decref) Task=`c90f6637-f76d-4257-8520-23dd942b6050`::ref 0 aborting False >Thread-88::DEBUG::2013-12-12 13:35:40,508::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-88::DEBUG::2013-12-12 13:35:40,841::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-89::DEBUG::2013-12-12 13:35:40,849::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-89::DEBUG::2013-12-12 13:35:41,017::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-94::DEBUG::2013-12-12 13:35:54,641::task::579::TaskManager.Task::(_updateState) Task=`e18a904e-e268-4cd5-be41-476795d3a1e1`::moving from state init -> state preparing >Thread-94::INFO::2013-12-12 13:35:54,642::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-94::INFO::2013-12-12 13:35:54,642::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-94::DEBUG::2013-12-12 13:35:54,642::task::1168::TaskManager.Task::(prepare) Task=`e18a904e-e268-4cd5-be41-476795d3a1e1`::finished: {} >Thread-94::DEBUG::2013-12-12 13:35:54,642::task::579::TaskManager.Task::(_updateState) Task=`e18a904e-e268-4cd5-be41-476795d3a1e1`::moving from state preparing -> state finished >Thread-94::DEBUG::2013-12-12 13:35:54,642::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-94::DEBUG::2013-12-12 13:35:54,642::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-94::DEBUG::2013-12-12 13:35:54,643::task::974::TaskManager.Task::(_decref) Task=`e18a904e-e268-4cd5-be41-476795d3a1e1`::ref 0 aborting False >Thread-96::DEBUG::2013-12-12 13:35:57,140::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-96::DEBUG::2013-12-12 13:35:57,473::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-97::DEBUG::2013-12-12 13:35:57,482::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-97::DEBUG::2013-12-12 13:35:57,647::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-98::DEBUG::2013-12-12 13:35:57,673::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeStatus with ('StartMigrationDuringRebalanceTest', '', '') {} >Thread-100::DEBUG::2013-12-12 13:35:57,804::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-98::DEBUG::2013-12-12 13:35:57,915::BindingXMLRPC::991::vds::(wrapper) return volumeStatus with {'volumeStatus': {'bricks': [{'status': 'ONLINE', 'brick': 'latest-a:/bricks/201312121333559771942637805', 'pid': '6101', 'port': '49152', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}, {'status': 'ONLINE', 'brick': 'latest-a:/bricks/20131212133357392850249563', 'pid': '6113', 'port': '49153', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}, {'status': 'ONLINE', 'brick': 'latest-a:/bricks/201312121333573941245056192', 'pid': '6124', 'port': '49154', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/20131212133357394550199115', 'pid': '5872', 'port': '49152', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/20131212133357395516730110', 'pid': '5883', 'port': '49153', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/201312121333573951287551485', 'pid': '5894', 'port': '49154', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/20131212133418659927299489', 'pid': '5905', 'port': '49155', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'brick': 'latest-a:/bricks/20131212133427138341374234', 'pid': '6136', 'port': '49155', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/20131212133434230219930446', 'pid': '5916', 'port': '49156', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'brick': 'latest-a:/bricks/201312121334434851151947411', 'pid': '6147', 'port': '49156', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}], 'nfs': [{'status': 'ONLINE', 'hostname': '10.14.16.127', 'pid': '5930', 'port': '2049', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'hostname': '10.14.16.132', 'pid': '6159', 'port': '2049', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}], 'shd': [], 'name': 'StartMigrationDuringRebalanceTest'}, 'status': {'message': 'Done', 'code': 0}} >Thread-100::DEBUG::2013-12-12 13:35:58,022::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-102::DEBUG::2013-12-12 13:36:02,683::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-102::DEBUG::2013-12-12 13:36:03,008::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-103::DEBUG::2013-12-12 13:36:03,016::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-103::DEBUG::2013-12-12 13:36:03,180::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-106::DEBUG::2013-12-12 13:36:09,765::task::579::TaskManager.Task::(_updateState) Task=`a1d06cc1-ab57-429b-98d7-62fdf01ce4ef`::moving from state init -> state preparing >Thread-106::INFO::2013-12-12 13:36:09,765::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-106::INFO::2013-12-12 13:36:09,765::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-106::DEBUG::2013-12-12 13:36:09,766::task::1168::TaskManager.Task::(prepare) Task=`a1d06cc1-ab57-429b-98d7-62fdf01ce4ef`::finished: {} >Thread-106::DEBUG::2013-12-12 13:36:09,766::task::579::TaskManager.Task::(_updateState) Task=`a1d06cc1-ab57-429b-98d7-62fdf01ce4ef`::moving from state preparing -> state finished >Thread-106::DEBUG::2013-12-12 13:36:09,766::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-106::DEBUG::2013-12-12 13:36:09,766::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-106::DEBUG::2013-12-12 13:36:09,766::task::974::TaskManager.Task::(_decref) Task=`a1d06cc1-ab57-429b-98d7-62fdf01ce4ef`::ref 0 aborting False >Thread-111::DEBUG::2013-12-12 13:36:19,297::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-111::DEBUG::2013-12-12 13:36:19,625::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-112::DEBUG::2013-12-12 13:36:19,636::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-112::DEBUG::2013-12-12 13:36:19,801::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-114::DEBUG::2013-12-12 13:36:24,887::task::579::TaskManager.Task::(_updateState) Task=`c00a9cd6-b15a-4cd9-b4c8-a3793a8b7f7f`::moving from state init -> state preparing >Thread-114::INFO::2013-12-12 13:36:24,887::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-114::INFO::2013-12-12 13:36:24,888::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-114::DEBUG::2013-12-12 13:36:24,888::task::1168::TaskManager.Task::(prepare) Task=`c00a9cd6-b15a-4cd9-b4c8-a3793a8b7f7f`::finished: {} >Thread-114::DEBUG::2013-12-12 13:36:24,888::task::579::TaskManager.Task::(_updateState) Task=`c00a9cd6-b15a-4cd9-b4c8-a3793a8b7f7f`::moving from state preparing -> state finished >Thread-114::DEBUG::2013-12-12 13:36:24,888::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-114::DEBUG::2013-12-12 13:36:24,888::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-114::DEBUG::2013-12-12 13:36:24,888::task::974::TaskManager.Task::(_decref) Task=`c00a9cd6-b15a-4cd9-b4c8-a3793a8b7f7f`::ref 0 aborting False >Thread-117::DEBUG::2013-12-12 13:36:30,364::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-117::DEBUG::2013-12-12 13:36:30,690::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-118::DEBUG::2013-12-12 13:36:30,701::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-118::DEBUG::2013-12-12 13:36:30,867::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-121::DEBUG::2013-12-12 13:36:35,895::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-121::DEBUG::2013-12-12 13:36:36,223::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-122::DEBUG::2013-12-12 13:36:36,237::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-122::DEBUG::2013-12-12 13:36:36,403::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-124::DEBUG::2013-12-12 13:36:39,993::task::579::TaskManager.Task::(_updateState) Task=`3cdef576-c4a6-4534-bcda-a45d5383dbc2`::moving from state init -> state preparing >Thread-124::INFO::2013-12-12 13:36:39,993::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-124::INFO::2013-12-12 13:36:39,993::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-124::DEBUG::2013-12-12 13:36:39,993::task::1168::TaskManager.Task::(prepare) Task=`3cdef576-c4a6-4534-bcda-a45d5383dbc2`::finished: {} >Thread-124::DEBUG::2013-12-12 13:36:39,994::task::579::TaskManager.Task::(_updateState) Task=`3cdef576-c4a6-4534-bcda-a45d5383dbc2`::moving from state preparing -> state finished >Thread-124::DEBUG::2013-12-12 13:36:39,994::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-124::DEBUG::2013-12-12 13:36:39,994::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-124::DEBUG::2013-12-12 13:36:39,994::task::974::TaskManager.Task::(_decref) Task=`3cdef576-c4a6-4534-bcda-a45d5383dbc2`::ref 0 aborting False >Thread-126::DEBUG::2013-12-12 13:36:41,445::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-126::DEBUG::2013-12-12 13:36:41,767::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-127::DEBUG::2013-12-12 13:36:41,777::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-127::DEBUG::2013-12-12 13:36:41,942::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-132::DEBUG::2013-12-12 13:36:55,097::task::579::TaskManager.Task::(_updateState) Task=`043125ed-b71a-48aa-8f8f-bff1944575ef`::moving from state init -> state preparing >Thread-132::INFO::2013-12-12 13:36:55,097::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-132::INFO::2013-12-12 13:36:55,098::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-132::DEBUG::2013-12-12 13:36:55,098::task::1168::TaskManager.Task::(prepare) Task=`043125ed-b71a-48aa-8f8f-bff1944575ef`::finished: {} >Thread-132::DEBUG::2013-12-12 13:36:55,098::task::579::TaskManager.Task::(_updateState) Task=`043125ed-b71a-48aa-8f8f-bff1944575ef`::moving from state preparing -> state finished >Thread-132::DEBUG::2013-12-12 13:36:55,098::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-132::DEBUG::2013-12-12 13:36:55,098::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-132::DEBUG::2013-12-12 13:36:55,098::task::974::TaskManager.Task::(_decref) Task=`043125ed-b71a-48aa-8f8f-bff1944575ef`::ref 0 aborting False >Thread-134::DEBUG::2013-12-12 13:36:58,037::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-135::DEBUG::2013-12-12 13:36:58,046::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-134::DEBUG::2013-12-12 13:36:58,442::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-135::DEBUG::2013-12-12 13:36:58,547::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-137::DEBUG::2013-12-12 13:36:58,556::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-137::DEBUG::2013-12-12 13:36:58,722::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-139::DEBUG::2013-12-12 13:37:03,772::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-139::DEBUG::2013-12-12 13:37:04,099::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-140::DEBUG::2013-12-12 13:37:04,109::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-140::DEBUG::2013-12-12 13:37:04,277::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-143::DEBUG::2013-12-12 13:37:09,304::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-143::DEBUG::2013-12-12 13:37:09,635::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-144::DEBUG::2013-12-12 13:37:09,647::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-144::DEBUG::2013-12-12 13:37:09,813::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-145::DEBUG::2013-12-12 13:37:10,501::task::579::TaskManager.Task::(_updateState) Task=`c3f7b38c-cf22-4a41-993d-6b44c6d0b679`::moving from state init -> state preparing >Thread-145::INFO::2013-12-12 13:37:10,501::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-145::INFO::2013-12-12 13:37:10,501::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-145::DEBUG::2013-12-12 13:37:10,502::task::1168::TaskManager.Task::(prepare) Task=`c3f7b38c-cf22-4a41-993d-6b44c6d0b679`::finished: {} >Thread-145::DEBUG::2013-12-12 13:37:10,502::task::579::TaskManager.Task::(_updateState) Task=`c3f7b38c-cf22-4a41-993d-6b44c6d0b679`::moving from state preparing -> state finished >Thread-145::DEBUG::2013-12-12 13:37:10,502::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-145::DEBUG::2013-12-12 13:37:10,502::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-145::DEBUG::2013-12-12 13:37:10,502::task::974::TaskManager.Task::(_decref) Task=`c3f7b38c-cf22-4a41-993d-6b44c6d0b679`::ref 0 aborting False >Thread-151::DEBUG::2013-12-12 13:37:25,623::task::579::TaskManager.Task::(_updateState) Task=`35a14b2c-960c-4e10-a8a9-5d31eca027e7`::moving from state init -> state preparing >Thread-151::INFO::2013-12-12 13:37:25,623::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-151::INFO::2013-12-12 13:37:25,623::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-151::DEBUG::2013-12-12 13:37:25,624::task::1168::TaskManager.Task::(prepare) Task=`35a14b2c-960c-4e10-a8a9-5d31eca027e7`::finished: {} >Thread-151::DEBUG::2013-12-12 13:37:25,624::task::579::TaskManager.Task::(_updateState) Task=`35a14b2c-960c-4e10-a8a9-5d31eca027e7`::moving from state preparing -> state finished >Thread-151::DEBUG::2013-12-12 13:37:25,624::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-151::DEBUG::2013-12-12 13:37:25,624::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-151::DEBUG::2013-12-12 13:37:25,624::task::974::TaskManager.Task::(_decref) Task=`35a14b2c-960c-4e10-a8a9-5d31eca027e7`::ref 0 aborting False >Thread-153::DEBUG::2013-12-12 13:37:25,894::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-153::DEBUG::2013-12-12 13:37:26,225::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-154::DEBUG::2013-12-12 13:37:26,234::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-154::DEBUG::2013-12-12 13:37:26,412::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-156::DEBUG::2013-12-12 13:37:31,435::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-156::DEBUG::2013-12-12 13:37:31,770::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-158::DEBUG::2013-12-12 13:37:31,778::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-158::DEBUG::2013-12-12 13:37:31,948::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-161::DEBUG::2013-12-12 13:37:40,778::task::579::TaskManager.Task::(_updateState) Task=`b032c416-ebc4-4b78-8b6a-3b6822a8262b`::moving from state init -> state preparing >Thread-161::INFO::2013-12-12 13:37:40,778::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-161::INFO::2013-12-12 13:37:40,778::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-161::DEBUG::2013-12-12 13:37:40,778::task::1168::TaskManager.Task::(prepare) Task=`b032c416-ebc4-4b78-8b6a-3b6822a8262b`::finished: {} >Thread-161::DEBUG::2013-12-12 13:37:40,779::task::579::TaskManager.Task::(_updateState) Task=`b032c416-ebc4-4b78-8b6a-3b6822a8262b`::moving from state preparing -> state finished >Thread-161::DEBUG::2013-12-12 13:37:40,779::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-161::DEBUG::2013-12-12 13:37:40,779::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-161::DEBUG::2013-12-12 13:37:40,779::task::974::TaskManager.Task::(_decref) Task=`b032c416-ebc4-4b78-8b6a-3b6822a8262b`::ref 0 aborting False >Thread-167::DEBUG::2013-12-12 13:37:55,889::task::579::TaskManager.Task::(_updateState) Task=`c59a797c-a88d-4739-8833-b8eb5c095eb4`::moving from state init -> state preparing >Thread-167::INFO::2013-12-12 13:37:55,889::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-167::INFO::2013-12-12 13:37:55,889::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-167::DEBUG::2013-12-12 13:37:55,890::task::1168::TaskManager.Task::(prepare) Task=`c59a797c-a88d-4739-8833-b8eb5c095eb4`::finished: {} >Thread-167::DEBUG::2013-12-12 13:37:55,890::task::579::TaskManager.Task::(_updateState) Task=`c59a797c-a88d-4739-8833-b8eb5c095eb4`::moving from state preparing -> state finished >Thread-167::DEBUG::2013-12-12 13:37:55,890::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-167::DEBUG::2013-12-12 13:37:55,890::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-167::DEBUG::2013-12-12 13:37:55,890::task::974::TaskManager.Task::(_decref) Task=`c59a797c-a88d-4739-8833-b8eb5c095eb4`::ref 0 aborting False >Thread-173::DEBUG::2013-12-12 13:38:10,173::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-173::DEBUG::2013-12-12 13:38:10,502::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-174::DEBUG::2013-12-12 13:38:10,514::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-174::DEBUG::2013-12-12 13:38:10,681::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-175::DEBUG::2013-12-12 13:38:10,992::task::579::TaskManager.Task::(_updateState) Task=`7a19bffb-0535-43c9-b465-70c347305780`::moving from state init -> state preparing >Thread-175::INFO::2013-12-12 13:38:10,992::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-175::INFO::2013-12-12 13:38:10,992::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-175::DEBUG::2013-12-12 13:38:10,992::task::1168::TaskManager.Task::(prepare) Task=`7a19bffb-0535-43c9-b465-70c347305780`::finished: {} >Thread-175::DEBUG::2013-12-12 13:38:10,992::task::579::TaskManager.Task::(_updateState) Task=`7a19bffb-0535-43c9-b465-70c347305780`::moving from state preparing -> state finished >Thread-175::DEBUG::2013-12-12 13:38:10,993::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-175::DEBUG::2013-12-12 13:38:10,993::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-175::DEBUG::2013-12-12 13:38:10,993::task::974::TaskManager.Task::(_decref) Task=`7a19bffb-0535-43c9-b465-70c347305780`::ref 0 aborting False >Thread-178::DEBUG::2013-12-12 13:38:15,717::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-178::DEBUG::2013-12-12 13:38:16,040::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-179::DEBUG::2013-12-12 13:38:16,055::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-179::DEBUG::2013-12-12 13:38:16,218::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-182::DEBUG::2013-12-12 13:38:21,244::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-182::DEBUG::2013-12-12 13:38:21,572::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-183::DEBUG::2013-12-12 13:38:21,589::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-183::DEBUG::2013-12-12 13:38:21,756::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-185::DEBUG::2013-12-12 13:38:26,094::task::579::TaskManager.Task::(_updateState) Task=`ee2dff77-5654-44e7-8c1f-aeea883cc00d`::moving from state init -> state preparing >Thread-185::INFO::2013-12-12 13:38:26,094::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-185::INFO::2013-12-12 13:38:26,094::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-185::DEBUG::2013-12-12 13:38:26,094::task::1168::TaskManager.Task::(prepare) Task=`ee2dff77-5654-44e7-8c1f-aeea883cc00d`::finished: {} >Thread-185::DEBUG::2013-12-12 13:38:26,095::task::579::TaskManager.Task::(_updateState) Task=`ee2dff77-5654-44e7-8c1f-aeea883cc00d`::moving from state preparing -> state finished >Thread-185::DEBUG::2013-12-12 13:38:26,095::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-185::DEBUG::2013-12-12 13:38:26,095::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-185::DEBUG::2013-12-12 13:38:26,095::task::974::TaskManager.Task::(_decref) Task=`ee2dff77-5654-44e7-8c1f-aeea883cc00d`::ref 0 aborting False >Thread-191::DEBUG::2013-12-12 13:38:41,237::task::579::TaskManager.Task::(_updateState) Task=`fc121cc4-cab3-4ae4-bde3-b69f262bd7da`::moving from state init -> state preparing >Thread-191::INFO::2013-12-12 13:38:41,238::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-191::INFO::2013-12-12 13:38:41,238::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-191::DEBUG::2013-12-12 13:38:41,238::task::1168::TaskManager.Task::(prepare) Task=`fc121cc4-cab3-4ae4-bde3-b69f262bd7da`::finished: {} >Thread-191::DEBUG::2013-12-12 13:38:41,238::task::579::TaskManager.Task::(_updateState) Task=`fc121cc4-cab3-4ae4-bde3-b69f262bd7da`::moving from state preparing -> state finished >Thread-191::DEBUG::2013-12-12 13:38:41,238::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-191::DEBUG::2013-12-12 13:38:41,238::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-191::DEBUG::2013-12-12 13:38:41,239::task::974::TaskManager.Task::(_decref) Task=`fc121cc4-cab3-4ae4-bde3-b69f262bd7da`::ref 0 aborting False >Thread-193::DEBUG::2013-12-12 13:38:43,382::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-193::DEBUG::2013-12-12 13:38:43,707::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-194::DEBUG::2013-12-12 13:38:43,715::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-194::DEBUG::2013-12-12 13:38:43,880::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-199::DEBUG::2013-12-12 13:38:56,360::task::579::TaskManager.Task::(_updateState) Task=`4ccc2449-7def-453a-9dad-b25cc53fca2d`::moving from state init -> state preparing >Thread-199::INFO::2013-12-12 13:38:56,360::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-199::INFO::2013-12-12 13:38:56,360::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-199::DEBUG::2013-12-12 13:38:56,360::task::1168::TaskManager.Task::(prepare) Task=`4ccc2449-7def-453a-9dad-b25cc53fca2d`::finished: {} >Thread-199::DEBUG::2013-12-12 13:38:56,360::task::579::TaskManager.Task::(_updateState) Task=`4ccc2449-7def-453a-9dad-b25cc53fca2d`::moving from state preparing -> state finished >Thread-199::DEBUG::2013-12-12 13:38:56,361::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-199::DEBUG::2013-12-12 13:38:56,361::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-199::DEBUG::2013-12-12 13:38:56,361::task::974::TaskManager.Task::(_decref) Task=`4ccc2449-7def-453a-9dad-b25cc53fca2d`::ref 0 aborting False >Thread-201::DEBUG::2013-12-12 13:38:58,648::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-201::DEBUG::2013-12-12 13:38:58,823::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-205::DEBUG::2013-12-12 13:39:05,543::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-205::DEBUG::2013-12-12 13:39:05,865::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-206::DEBUG::2013-12-12 13:39:05,875::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-206::DEBUG::2013-12-12 13:39:06,039::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-208::DEBUG::2013-12-12 13:39:11,457::task::579::TaskManager.Task::(_updateState) Task=`78d0679a-fa99-40b8-b328-b2d70bcdc284`::moving from state init -> state preparing >Thread-208::INFO::2013-12-12 13:39:11,458::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-208::INFO::2013-12-12 13:39:11,458::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-208::DEBUG::2013-12-12 13:39:11,458::task::1168::TaskManager.Task::(prepare) Task=`78d0679a-fa99-40b8-b328-b2d70bcdc284`::finished: {} >Thread-208::DEBUG::2013-12-12 13:39:11,458::task::579::TaskManager.Task::(_updateState) Task=`78d0679a-fa99-40b8-b328-b2d70bcdc284`::moving from state preparing -> state finished >Thread-208::DEBUG::2013-12-12 13:39:11,458::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-208::DEBUG::2013-12-12 13:39:11,459::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-208::DEBUG::2013-12-12 13:39:11,459::task::974::TaskManager.Task::(_decref) Task=`78d0679a-fa99-40b8-b328-b2d70bcdc284`::ref 0 aborting False >Thread-211::DEBUG::2013-12-12 13:39:16,602::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-211::DEBUG::2013-12-12 13:39:16,938::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-212::DEBUG::2013-12-12 13:39:16,946::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-212::DEBUG::2013-12-12 13:39:17,108::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-216::DEBUG::2013-12-12 13:39:26,563::task::579::TaskManager.Task::(_updateState) Task=`8d0809a2-c1ba-4516-aabd-b939e643616f`::moving from state init -> state preparing >Thread-216::INFO::2013-12-12 13:39:26,563::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-216::INFO::2013-12-12 13:39:26,563::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-216::DEBUG::2013-12-12 13:39:26,563::task::1168::TaskManager.Task::(prepare) Task=`8d0809a2-c1ba-4516-aabd-b939e643616f`::finished: {} >Thread-216::DEBUG::2013-12-12 13:39:26,563::task::579::TaskManager.Task::(_updateState) Task=`8d0809a2-c1ba-4516-aabd-b939e643616f`::moving from state preparing -> state finished >Thread-216::DEBUG::2013-12-12 13:39:26,564::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-216::DEBUG::2013-12-12 13:39:26,564::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-216::DEBUG::2013-12-12 13:39:26,564::task::974::TaskManager.Task::(_decref) Task=`8d0809a2-c1ba-4516-aabd-b939e643616f`::ref 0 aborting False >Thread-218::DEBUG::2013-12-12 13:39:27,694::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-218::DEBUG::2013-12-12 13:39:28,019::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-219::DEBUG::2013-12-12 13:39:28,032::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-219::DEBUG::2013-12-12 13:39:28,197::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-222::DEBUG::2013-12-12 13:39:33,226::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-222::DEBUG::2013-12-12 13:39:33,556::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-223::DEBUG::2013-12-12 13:39:33,564::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-223::DEBUG::2013-12-12 13:39:33,731::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-226::DEBUG::2013-12-12 13:39:41,747::task::579::TaskManager.Task::(_updateState) Task=`950d80a9-5a2c-49db-ad92-419f0274f7a3`::moving from state init -> state preparing >Thread-226::INFO::2013-12-12 13:39:41,747::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-226::INFO::2013-12-12 13:39:41,747::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-226::DEBUG::2013-12-12 13:39:41,747::task::1168::TaskManager.Task::(prepare) Task=`950d80a9-5a2c-49db-ad92-419f0274f7a3`::finished: {} >Thread-226::DEBUG::2013-12-12 13:39:41,747::task::579::TaskManager.Task::(_updateState) Task=`950d80a9-5a2c-49db-ad92-419f0274f7a3`::moving from state preparing -> state finished >Thread-226::DEBUG::2013-12-12 13:39:41,748::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-226::DEBUG::2013-12-12 13:39:41,748::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-226::DEBUG::2013-12-12 13:39:41,748::task::974::TaskManager.Task::(_decref) Task=`950d80a9-5a2c-49db-ad92-419f0274f7a3`::ref 0 aborting False >Thread-228::DEBUG::2013-12-12 13:39:44,307::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-228::DEBUG::2013-12-12 13:39:44,637::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-229::DEBUG::2013-12-12 13:39:44,644::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-229::DEBUG::2013-12-12 13:39:44,814::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-232::DEBUG::2013-12-12 13:39:49,852::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-232::DEBUG::2013-12-12 13:39:50,179::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-233::DEBUG::2013-12-12 13:39:50,190::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-233::DEBUG::2013-12-12 13:39:50,354::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-236::DEBUG::2013-12-12 13:39:56,890::task::579::TaskManager.Task::(_updateState) Task=`eb2f2602-7071-4f95-ae32-180eb7a88b1b`::moving from state init -> state preparing >Thread-236::INFO::2013-12-12 13:39:56,890::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-236::INFO::2013-12-12 13:39:56,891::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-236::DEBUG::2013-12-12 13:39:56,891::task::1168::TaskManager.Task::(prepare) Task=`eb2f2602-7071-4f95-ae32-180eb7a88b1b`::finished: {} >Thread-236::DEBUG::2013-12-12 13:39:56,891::task::579::TaskManager.Task::(_updateState) Task=`eb2f2602-7071-4f95-ae32-180eb7a88b1b`::moving from state preparing -> state finished >Thread-236::DEBUG::2013-12-12 13:39:56,891::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-236::DEBUG::2013-12-12 13:39:56,891::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2013-12-12 13:39:56,891::task::974::TaskManager.Task::(_decref) Task=`eb2f2602-7071-4f95-ae32-180eb7a88b1b`::ref 0 aborting False >Thread-239::DEBUG::2013-12-12 13:40:00,917::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-239::DEBUG::2013-12-12 13:40:01,254::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-240::DEBUG::2013-12-12 13:40:01,266::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-240::DEBUG::2013-12-12 13:40:01,433::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-244::DEBUG::2013-12-12 13:40:11,983::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-245::DEBUG::2013-12-12 13:40:11,994::task::579::TaskManager.Task::(_updateState) Task=`56147614-0f2a-4028-87f2-1b9eceb788ff`::moving from state init -> state preparing >Thread-245::INFO::2013-12-12 13:40:11,994::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-245::INFO::2013-12-12 13:40:11,994::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-245::DEBUG::2013-12-12 13:40:11,994::task::1168::TaskManager.Task::(prepare) Task=`56147614-0f2a-4028-87f2-1b9eceb788ff`::finished: {} >Thread-245::DEBUG::2013-12-12 13:40:11,994::task::579::TaskManager.Task::(_updateState) Task=`56147614-0f2a-4028-87f2-1b9eceb788ff`::moving from state preparing -> state finished >Thread-245::DEBUG::2013-12-12 13:40:11,995::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-245::DEBUG::2013-12-12 13:40:11,995::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-245::DEBUG::2013-12-12 13:40:11,995::task::974::TaskManager.Task::(_decref) Task=`56147614-0f2a-4028-87f2-1b9eceb788ff`::ref 0 aborting False >Thread-244::DEBUG::2013-12-12 13:40:12,319::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-247::DEBUG::2013-12-12 13:40:12,328::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-247::DEBUG::2013-12-12 13:40:12,494::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-249::DEBUG::2013-12-12 13:40:17,519::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-249::DEBUG::2013-12-12 13:40:17,844::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-250::DEBUG::2013-12-12 13:40:17,853::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-250::DEBUG::2013-12-12 13:40:18,018::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-253::DEBUG::2013-12-12 13:40:23,048::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-253::DEBUG::2013-12-12 13:40:23,375::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-254::DEBUG::2013-12-12 13:40:23,383::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-254::DEBUG::2013-12-12 13:40:23,549::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-256::DEBUG::2013-12-12 13:40:27,097::task::579::TaskManager.Task::(_updateState) Task=`91b31fe0-3116-4319-b6ec-f7d576c25e50`::moving from state init -> state preparing >Thread-256::INFO::2013-12-12 13:40:27,098::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-256::INFO::2013-12-12 13:40:27,098::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-256::DEBUG::2013-12-12 13:40:27,098::task::1168::TaskManager.Task::(prepare) Task=`91b31fe0-3116-4319-b6ec-f7d576c25e50`::finished: {} >Thread-256::DEBUG::2013-12-12 13:40:27,098::task::579::TaskManager.Task::(_updateState) Task=`91b31fe0-3116-4319-b6ec-f7d576c25e50`::moving from state preparing -> state finished >Thread-256::DEBUG::2013-12-12 13:40:27,098::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256::DEBUG::2013-12-12 13:40:27,099::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256::DEBUG::2013-12-12 13:40:27,099::task::974::TaskManager.Task::(_decref) Task=`91b31fe0-3116-4319-b6ec-f7d576c25e50`::ref 0 aborting False >Thread-262::DEBUG::2013-12-12 13:40:39,634::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-262::DEBUG::2013-12-12 13:40:39,960::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-263::DEBUG::2013-12-12 13:40:39,968::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-263::DEBUG::2013-12-12 13:40:40,136::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-264::DEBUG::2013-12-12 13:40:42,200::task::579::TaskManager.Task::(_updateState) Task=`2fdcb093-91b4-42b3-bcc4-e4b5badd1db2`::moving from state init -> state preparing >Thread-264::INFO::2013-12-12 13:40:42,200::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-264::INFO::2013-12-12 13:40:42,200::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-264::DEBUG::2013-12-12 13:40:42,200::task::1168::TaskManager.Task::(prepare) Task=`2fdcb093-91b4-42b3-bcc4-e4b5badd1db2`::finished: {} >Thread-264::DEBUG::2013-12-12 13:40:42,200::task::579::TaskManager.Task::(_updateState) Task=`2fdcb093-91b4-42b3-bcc4-e4b5badd1db2`::moving from state preparing -> state finished >Thread-264::DEBUG::2013-12-12 13:40:42,201::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-264::DEBUG::2013-12-12 13:40:42,201::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-264::DEBUG::2013-12-12 13:40:42,201::task::974::TaskManager.Task::(_decref) Task=`2fdcb093-91b4-42b3-bcc4-e4b5badd1db2`::ref 0 aborting False >Thread-266::DEBUG::2013-12-12 13:40:45,158::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-266::DEBUG::2013-12-12 13:40:45,492::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-268::DEBUG::2013-12-12 13:40:45,501::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-268::DEBUG::2013-12-12 13:40:45,668::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-272::DEBUG::2013-12-12 13:40:57,332::task::579::TaskManager.Task::(_updateState) Task=`e8cf3da2-3400-4ad0-a5e0-851bfdb63b97`::moving from state init -> state preparing >Thread-272::INFO::2013-12-12 13:40:57,332::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-272::INFO::2013-12-12 13:40:57,333::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-272::DEBUG::2013-12-12 13:40:57,333::task::1168::TaskManager.Task::(prepare) Task=`e8cf3da2-3400-4ad0-a5e0-851bfdb63b97`::finished: {} >Thread-272::DEBUG::2013-12-12 13:40:57,333::task::579::TaskManager.Task::(_updateState) Task=`e8cf3da2-3400-4ad0-a5e0-851bfdb63b97`::moving from state preparing -> state finished >Thread-272::DEBUG::2013-12-12 13:40:57,333::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-272::DEBUG::2013-12-12 13:40:57,333::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-272::DEBUG::2013-12-12 13:40:57,333::task::974::TaskManager.Task::(_decref) Task=`e8cf3da2-3400-4ad0-a5e0-851bfdb63b97`::ref 0 aborting False >Thread-278::DEBUG::2013-12-12 13:41:12,527::task::579::TaskManager.Task::(_updateState) Task=`478605de-2d3c-471c-9b19-34c2d70a1ff2`::moving from state init -> state preparing >Thread-278::INFO::2013-12-12 13:41:12,528::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-278::INFO::2013-12-12 13:41:12,528::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-278::DEBUG::2013-12-12 13:41:12,528::task::1168::TaskManager.Task::(prepare) Task=`478605de-2d3c-471c-9b19-34c2d70a1ff2`::finished: {} >Thread-278::DEBUG::2013-12-12 13:41:12,528::task::579::TaskManager.Task::(_updateState) Task=`478605de-2d3c-471c-9b19-34c2d70a1ff2`::moving from state preparing -> state finished >Thread-278::DEBUG::2013-12-12 13:41:12,528::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-278::DEBUG::2013-12-12 13:41:12,529::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-278::DEBUG::2013-12-12 13:41:12,529::task::974::TaskManager.Task::(_decref) Task=`478605de-2d3c-471c-9b19-34c2d70a1ff2`::ref 0 aborting False >Thread-283::DEBUG::2013-12-12 13:41:23,946::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-283::DEBUG::2013-12-12 13:41:24,277::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-284::DEBUG::2013-12-12 13:41:24,287::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-284::DEBUG::2013-12-12 13:41:24,457::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-286::DEBUG::2013-12-12 13:41:27,668::task::579::TaskManager.Task::(_updateState) Task=`ccfef871-7213-4bc0-8223-e0ea6ca58c2e`::moving from state init -> state preparing >Thread-286::INFO::2013-12-12 13:41:27,669::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286::INFO::2013-12-12 13:41:27,669::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-286::DEBUG::2013-12-12 13:41:27,669::task::1168::TaskManager.Task::(prepare) Task=`ccfef871-7213-4bc0-8223-e0ea6ca58c2e`::finished: {} >Thread-286::DEBUG::2013-12-12 13:41:27,669::task::579::TaskManager.Task::(_updateState) Task=`ccfef871-7213-4bc0-8223-e0ea6ca58c2e`::moving from state preparing -> state finished >Thread-286::DEBUG::2013-12-12 13:41:27,669::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286::DEBUG::2013-12-12 13:41:27,669::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286::DEBUG::2013-12-12 13:41:27,670::task::974::TaskManager.Task::(_decref) Task=`ccfef871-7213-4bc0-8223-e0ea6ca58c2e`::ref 0 aborting False >Thread-290::DEBUG::2013-12-12 13:41:35,002::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-290::DEBUG::2013-12-12 13:41:35,327::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-291::DEBUG::2013-12-12 13:41:35,336::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-291::DEBUG::2013-12-12 13:41:35,501::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-294::DEBUG::2013-12-12 13:41:40,530::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-294::DEBUG::2013-12-12 13:41:40,855::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-295::DEBUG::2013-12-12 13:41:40,868::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-295::DEBUG::2013-12-12 13:41:41,037::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-296::DEBUG::2013-12-12 13:41:42,799::task::579::TaskManager.Task::(_updateState) Task=`ab3a3933-7c2d-454a-b326-6a9fa5056045`::moving from state init -> state preparing >Thread-296::INFO::2013-12-12 13:41:42,799::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-296::INFO::2013-12-12 13:41:42,799::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-296::DEBUG::2013-12-12 13:41:42,800::task::1168::TaskManager.Task::(prepare) Task=`ab3a3933-7c2d-454a-b326-6a9fa5056045`::finished: {} >Thread-296::DEBUG::2013-12-12 13:41:42,800::task::579::TaskManager.Task::(_updateState) Task=`ab3a3933-7c2d-454a-b326-6a9fa5056045`::moving from state preparing -> state finished >Thread-296::DEBUG::2013-12-12 13:41:42,800::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-296::DEBUG::2013-12-12 13:41:42,800::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-296::DEBUG::2013-12-12 13:41:42,800::task::974::TaskManager.Task::(_decref) Task=`ab3a3933-7c2d-454a-b326-6a9fa5056045`::ref 0 aborting False >Thread-299::DEBUG::2013-12-12 13:41:46,057::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-299::DEBUG::2013-12-12 13:41:46,389::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-300::DEBUG::2013-12-12 13:41:46,397::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-300::DEBUG::2013-12-12 13:41:46,562::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-302::DEBUG::2013-12-12 13:41:51,594::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-302::DEBUG::2013-12-12 13:41:51,918::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-303::DEBUG::2013-12-12 13:41:51,928::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-303::DEBUG::2013-12-12 13:41:52,095::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-306::DEBUG::2013-12-12 13:41:57,117::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-306::DEBUG::2013-12-12 13:41:57,446::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-307::DEBUG::2013-12-12 13:41:57,453::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-307::DEBUG::2013-12-12 13:41:57,619::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-308::DEBUG::2013-12-12 13:41:57,960::task::579::TaskManager.Task::(_updateState) Task=`3ef4a318-6d56-4eba-9b99-9992e40087ce`::moving from state init -> state preparing >Thread-308::INFO::2013-12-12 13:41:57,960::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-308::INFO::2013-12-12 13:41:57,961::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-308::DEBUG::2013-12-12 13:41:57,961::task::1168::TaskManager.Task::(prepare) Task=`3ef4a318-6d56-4eba-9b99-9992e40087ce`::finished: {} >Thread-308::DEBUG::2013-12-12 13:41:57,961::task::579::TaskManager.Task::(_updateState) Task=`3ef4a318-6d56-4eba-9b99-9992e40087ce`::moving from state preparing -> state finished >Thread-308::DEBUG::2013-12-12 13:41:57,961::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-308::DEBUG::2013-12-12 13:41:57,961::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-308::DEBUG::2013-12-12 13:41:57,961::task::974::TaskManager.Task::(_decref) Task=`3ef4a318-6d56-4eba-9b99-9992e40087ce`::ref 0 aborting False >Thread-310::DEBUG::2013-12-12 13:41:59,213::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-310::DEBUG::2013-12-12 13:41:59,386::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-315::DEBUG::2013-12-12 13:42:13,072::task::579::TaskManager.Task::(_updateState) Task=`d2921916-7fc0-4ee0-983b-5dbf06faa7c5`::moving from state init -> state preparing >Thread-315::INFO::2013-12-12 13:42:13,072::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-315::INFO::2013-12-12 13:42:13,072::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-315::DEBUG::2013-12-12 13:42:13,072::task::1168::TaskManager.Task::(prepare) Task=`d2921916-7fc0-4ee0-983b-5dbf06faa7c5`::finished: {} >Thread-315::DEBUG::2013-12-12 13:42:13,072::task::579::TaskManager.Task::(_updateState) Task=`d2921916-7fc0-4ee0-983b-5dbf06faa7c5`::moving from state preparing -> state finished >Thread-315::DEBUG::2013-12-12 13:42:13,073::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-315::DEBUG::2013-12-12 13:42:13,073::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-315::DEBUG::2013-12-12 13:42:13,073::task::974::TaskManager.Task::(_decref) Task=`d2921916-7fc0-4ee0-983b-5dbf06faa7c5`::ref 0 aborting False >Thread-321::DEBUG::2013-12-12 13:42:29,277::task::579::TaskManager.Task::(_updateState) Task=`83f4f15b-4874-4ee0-8236-3d141f3b90f4`::moving from state init -> state preparing >Thread-321::INFO::2013-12-12 13:42:29,278::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-321::INFO::2013-12-12 13:42:29,278::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-321::DEBUG::2013-12-12 13:42:29,278::task::1168::TaskManager.Task::(prepare) Task=`83f4f15b-4874-4ee0-8236-3d141f3b90f4`::finished: {} >Thread-321::DEBUG::2013-12-12 13:42:29,278::task::579::TaskManager.Task::(_updateState) Task=`83f4f15b-4874-4ee0-8236-3d141f3b90f4`::moving from state preparing -> state finished >Thread-321::DEBUG::2013-12-12 13:42:29,278::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-321::DEBUG::2013-12-12 13:42:29,278::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-321::DEBUG::2013-12-12 13:42:29,279::task::974::TaskManager.Task::(_decref) Task=`83f4f15b-4874-4ee0-8236-3d141f3b90f4`::ref 0 aborting False >Thread-325::DEBUG::2013-12-12 13:42:36,919::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-325::DEBUG::2013-12-12 13:42:37,248::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-326::DEBUG::2013-12-12 13:42:37,256::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-326::DEBUG::2013-12-12 13:42:37,422::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-329::DEBUG::2013-12-12 13:42:44,381::task::579::TaskManager.Task::(_updateState) Task=`0b343e75-176b-4ecf-abed-be17d9778394`::moving from state init -> state preparing >Thread-329::INFO::2013-12-12 13:42:44,381::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-329::INFO::2013-12-12 13:42:44,381::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-329::DEBUG::2013-12-12 13:42:44,381::task::1168::TaskManager.Task::(prepare) Task=`0b343e75-176b-4ecf-abed-be17d9778394`::finished: {} >Thread-329::DEBUG::2013-12-12 13:42:44,381::task::579::TaskManager.Task::(_updateState) Task=`0b343e75-176b-4ecf-abed-be17d9778394`::moving from state preparing -> state finished >Thread-329::DEBUG::2013-12-12 13:42:44,382::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-329::DEBUG::2013-12-12 13:42:44,382::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-329::DEBUG::2013-12-12 13:42:44,382::task::974::TaskManager.Task::(_decref) Task=`0b343e75-176b-4ecf-abed-be17d9778394`::ref 0 aborting False >Thread-332::DEBUG::2013-12-12 13:42:47,975::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-332::DEBUG::2013-12-12 13:42:48,299::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-333::DEBUG::2013-12-12 13:42:48,307::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-333::DEBUG::2013-12-12 13:42:48,471::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-336::DEBUG::2013-12-12 13:42:53,494::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-336::DEBUG::2013-12-12 13:42:53,832::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-337::DEBUG::2013-12-12 13:42:53,841::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-337::DEBUG::2013-12-12 13:42:54,008::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-339::DEBUG::2013-12-12 13:42:59,474::task::579::TaskManager.Task::(_updateState) Task=`2922087d-a80e-46fc-ada7-e118e675318b`::moving from state init -> state preparing >Thread-339::INFO::2013-12-12 13:42:59,475::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-339::INFO::2013-12-12 13:42:59,475::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-339::DEBUG::2013-12-12 13:42:59,475::task::1168::TaskManager.Task::(prepare) Task=`2922087d-a80e-46fc-ada7-e118e675318b`::finished: {} >Thread-339::DEBUG::2013-12-12 13:42:59,475::task::579::TaskManager.Task::(_updateState) Task=`2922087d-a80e-46fc-ada7-e118e675318b`::moving from state preparing -> state finished >Thread-339::DEBUG::2013-12-12 13:42:59,475::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-339::DEBUG::2013-12-12 13:42:59,476::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-339::DEBUG::2013-12-12 13:42:59,476::task::974::TaskManager.Task::(_decref) Task=`2922087d-a80e-46fc-ada7-e118e675318b`::ref 0 aborting False >Thread-342::DEBUG::2013-12-12 13:43:04,560::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-342::DEBUG::2013-12-12 13:43:04,888::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-343::DEBUG::2013-12-12 13:43:04,895::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-343::DEBUG::2013-12-12 13:43:05,060::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-347::DEBUG::2013-12-12 13:43:14,600::task::579::TaskManager.Task::(_updateState) Task=`bb63a834-8a62-4015-a783-c9043e66b999`::moving from state init -> state preparing >Thread-347::INFO::2013-12-12 13:43:14,601::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-347::INFO::2013-12-12 13:43:14,601::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-347::DEBUG::2013-12-12 13:43:14,601::task::1168::TaskManager.Task::(prepare) Task=`bb63a834-8a62-4015-a783-c9043e66b999`::finished: {} >Thread-347::DEBUG::2013-12-12 13:43:14,601::task::579::TaskManager.Task::(_updateState) Task=`bb63a834-8a62-4015-a783-c9043e66b999`::moving from state preparing -> state finished >Thread-347::DEBUG::2013-12-12 13:43:14,601::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-347::DEBUG::2013-12-12 13:43:14,602::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-347::DEBUG::2013-12-12 13:43:14,602::task::974::TaskManager.Task::(_decref) Task=`bb63a834-8a62-4015-a783-c9043e66b999`::ref 0 aborting False >Thread-351::DEBUG::2013-12-12 13:43:21,158::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-351::DEBUG::2013-12-12 13:43:21,489::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-352::DEBUG::2013-12-12 13:43:21,497::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-352::DEBUG::2013-12-12 13:43:21,664::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-355::DEBUG::2013-12-12 13:43:29,776::task::579::TaskManager.Task::(_updateState) Task=`a0c11328-51ae-474c-ae76-96ba217a7591`::moving from state init -> state preparing >Thread-355::INFO::2013-12-12 13:43:29,776::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-355::INFO::2013-12-12 13:43:29,776::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-355::DEBUG::2013-12-12 13:43:29,776::task::1168::TaskManager.Task::(prepare) Task=`a0c11328-51ae-474c-ae76-96ba217a7591`::finished: {} >Thread-355::DEBUG::2013-12-12 13:43:29,777::task::579::TaskManager.Task::(_updateState) Task=`a0c11328-51ae-474c-ae76-96ba217a7591`::moving from state preparing -> state finished >Thread-355::DEBUG::2013-12-12 13:43:29,777::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-355::DEBUG::2013-12-12 13:43:29,777::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-355::DEBUG::2013-12-12 13:43:29,777::task::974::TaskManager.Task::(_decref) Task=`a0c11328-51ae-474c-ae76-96ba217a7591`::ref 0 aborting False >Thread-357::DEBUG::2013-12-12 13:43:32,237::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-357::DEBUG::2013-12-12 13:43:32,565::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-358::DEBUG::2013-12-12 13:43:32,574::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-358::DEBUG::2013-12-12 13:43:32,741::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-361::DEBUG::2013-12-12 13:43:37,765::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-361::DEBUG::2013-12-12 13:43:38,098::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-362::DEBUG::2013-12-12 13:43:38,107::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-362::DEBUG::2013-12-12 13:43:38,272::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-365::DEBUG::2013-12-12 13:43:44,884::task::579::TaskManager.Task::(_updateState) Task=`330e0d8a-8dc8-4df2-88dc-d148e76edab7`::moving from state init -> state preparing >Thread-365::INFO::2013-12-12 13:43:44,884::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-365::INFO::2013-12-12 13:43:44,884::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-365::DEBUG::2013-12-12 13:43:44,884::task::1168::TaskManager.Task::(prepare) Task=`330e0d8a-8dc8-4df2-88dc-d148e76edab7`::finished: {} >Thread-365::DEBUG::2013-12-12 13:43:44,885::task::579::TaskManager.Task::(_updateState) Task=`330e0d8a-8dc8-4df2-88dc-d148e76edab7`::moving from state preparing -> state finished >Thread-365::DEBUG::2013-12-12 13:43:44,885::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-365::DEBUG::2013-12-12 13:43:44,885::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-365::DEBUG::2013-12-12 13:43:44,885::task::974::TaskManager.Task::(_decref) Task=`330e0d8a-8dc8-4df2-88dc-d148e76edab7`::ref 0 aborting False >Thread-368::DEBUG::2013-12-12 13:43:48,838::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-368::DEBUG::2013-12-12 13:43:49,174::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-369::DEBUG::2013-12-12 13:43:49,188::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-369::DEBUG::2013-12-12 13:43:49,362::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-373::DEBUG::2013-12-12 13:44:00,000::task::579::TaskManager.Task::(_updateState) Task=`22bcd001-996d-4c5a-8097-d7fa784bdd1b`::moving from state init -> state preparing >Thread-373::INFO::2013-12-12 13:44:00,000::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-373::INFO::2013-12-12 13:44:00,000::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-373::DEBUG::2013-12-12 13:44:00,001::task::1168::TaskManager.Task::(prepare) Task=`22bcd001-996d-4c5a-8097-d7fa784bdd1b`::finished: {} >Thread-373::DEBUG::2013-12-12 13:44:00,001::task::579::TaskManager.Task::(_updateState) Task=`22bcd001-996d-4c5a-8097-d7fa784bdd1b`::moving from state preparing -> state finished >Thread-373::DEBUG::2013-12-12 13:44:00,001::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-373::DEBUG::2013-12-12 13:44:00,001::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-373::DEBUG::2013-12-12 13:44:00,001::task::974::TaskManager.Task::(_decref) Task=`22bcd001-996d-4c5a-8097-d7fa784bdd1b`::ref 0 aborting False >Thread-375::DEBUG::2013-12-12 13:44:00,684::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-375::DEBUG::2013-12-12 13:44:00,859::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-377::DEBUG::2013-12-12 13:44:05,442::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-377::DEBUG::2013-12-12 13:44:05,769::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-378::DEBUG::2013-12-12 13:44:05,777::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-378::DEBUG::2013-12-12 13:44:05,941::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-381::DEBUG::2013-12-12 13:44:10,970::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-381::DEBUG::2013-12-12 13:44:11,300::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-382::DEBUG::2013-12-12 13:44:11,308::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-382::DEBUG::2013-12-12 13:44:11,473::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-384::DEBUG::2013-12-12 13:44:15,136::task::579::TaskManager.Task::(_updateState) Task=`95a18903-d6ad-40b0-a30d-ab4800612992`::moving from state init -> state preparing >Thread-384::INFO::2013-12-12 13:44:15,136::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-384::INFO::2013-12-12 13:44:15,136::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-384::DEBUG::2013-12-12 13:44:15,136::task::1168::TaskManager.Task::(prepare) Task=`95a18903-d6ad-40b0-a30d-ab4800612992`::finished: {} >Thread-384::DEBUG::2013-12-12 13:44:15,136::task::579::TaskManager.Task::(_updateState) Task=`95a18903-d6ad-40b0-a30d-ab4800612992`::moving from state preparing -> state finished >Thread-384::DEBUG::2013-12-12 13:44:15,136::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-384::DEBUG::2013-12-12 13:44:15,137::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-384::DEBUG::2013-12-12 13:44:15,137::task::974::TaskManager.Task::(_decref) Task=`95a18903-d6ad-40b0-a30d-ab4800612992`::ref 0 aborting False >Thread-388::DEBUG::2013-12-12 13:44:22,031::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-388::DEBUG::2013-12-12 13:44:22,357::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-389::DEBUG::2013-12-12 13:44:22,364::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-389::DEBUG::2013-12-12 13:44:22,532::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-392::DEBUG::2013-12-12 13:44:30,233::task::579::TaskManager.Task::(_updateState) Task=`07628a8f-1e9f-442c-b91a-5031f616dc48`::moving from state init -> state preparing >Thread-392::INFO::2013-12-12 13:44:30,233::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-392::INFO::2013-12-12 13:44:30,233::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-392::DEBUG::2013-12-12 13:44:30,233::task::1168::TaskManager.Task::(prepare) Task=`07628a8f-1e9f-442c-b91a-5031f616dc48`::finished: {} >Thread-392::DEBUG::2013-12-12 13:44:30,234::task::579::TaskManager.Task::(_updateState) Task=`07628a8f-1e9f-442c-b91a-5031f616dc48`::moving from state preparing -> state finished >Thread-392::DEBUG::2013-12-12 13:44:30,234::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-392::DEBUG::2013-12-12 13:44:30,234::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-392::DEBUG::2013-12-12 13:44:30,234::task::974::TaskManager.Task::(_decref) Task=`07628a8f-1e9f-442c-b91a-5031f616dc48`::ref 0 aborting False >Thread-398::DEBUG::2013-12-12 13:44:45,335::task::579::TaskManager.Task::(_updateState) Task=`a0d1d2bf-58ce-434e-9557-5d969498ac69`::moving from state init -> state preparing >Thread-398::INFO::2013-12-12 13:44:45,335::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-398::INFO::2013-12-12 13:44:45,335::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-398::DEBUG::2013-12-12 13:44:45,335::task::1168::TaskManager.Task::(prepare) Task=`a0d1d2bf-58ce-434e-9557-5d969498ac69`::finished: {} >Thread-398::DEBUG::2013-12-12 13:44:45,335::task::579::TaskManager.Task::(_updateState) Task=`a0d1d2bf-58ce-434e-9557-5d969498ac69`::moving from state preparing -> state finished >Thread-398::DEBUG::2013-12-12 13:44:45,336::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-398::DEBUG::2013-12-12 13:44:45,336::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-398::DEBUG::2013-12-12 13:44:45,336::task::974::TaskManager.Task::(_decref) Task=`a0d1d2bf-58ce-434e-9557-5d969498ac69`::ref 0 aborting False >Thread-401::DEBUG::2013-12-12 13:44:49,649::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-401::DEBUG::2013-12-12 13:44:49,994::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-402::DEBUG::2013-12-12 13:44:50,002::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-402::DEBUG::2013-12-12 13:44:50,171::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-405::DEBUG::2013-12-12 13:44:55,192::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-405::DEBUG::2013-12-12 13:44:55,524::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-406::DEBUG::2013-12-12 13:44:55,534::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-406::DEBUG::2013-12-12 13:44:55,701::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-408::DEBUG::2013-12-12 13:45:00,426::task::579::TaskManager.Task::(_updateState) Task=`cb472d30-a1f3-46a9-be24-4230088aaf3e`::moving from state init -> state preparing >Thread-408::INFO::2013-12-12 13:45:00,426::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-408::INFO::2013-12-12 13:45:00,426::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-408::DEBUG::2013-12-12 13:45:00,426::task::1168::TaskManager.Task::(prepare) Task=`cb472d30-a1f3-46a9-be24-4230088aaf3e`::finished: {} >Thread-408::DEBUG::2013-12-12 13:45:00,426::task::579::TaskManager.Task::(_updateState) Task=`cb472d30-a1f3-46a9-be24-4230088aaf3e`::moving from state preparing -> state finished >Thread-408::DEBUG::2013-12-12 13:45:00,427::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-408::DEBUG::2013-12-12 13:45:00,427::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-408::DEBUG::2013-12-12 13:45:00,427::task::974::TaskManager.Task::(_decref) Task=`cb472d30-a1f3-46a9-be24-4230088aaf3e`::ref 0 aborting False >Thread-413::DEBUG::2013-12-12 13:45:11,945::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-413::DEBUG::2013-12-12 13:45:12,277::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-414::DEBUG::2013-12-12 13:45:12,284::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-414::DEBUG::2013-12-12 13:45:12,451::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-416::DEBUG::2013-12-12 13:45:15,520::task::579::TaskManager.Task::(_updateState) Task=`5b4b013f-afb5-4fd5-bce8-644505774a7b`::moving from state init -> state preparing >Thread-416::INFO::2013-12-12 13:45:15,520::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-416::INFO::2013-12-12 13:45:15,520::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-416::DEBUG::2013-12-12 13:45:15,520::task::1168::TaskManager.Task::(prepare) Task=`5b4b013f-afb5-4fd5-bce8-644505774a7b`::finished: {} >Thread-416::DEBUG::2013-12-12 13:45:15,520::task::579::TaskManager.Task::(_updateState) Task=`5b4b013f-afb5-4fd5-bce8-644505774a7b`::moving from state preparing -> state finished >Thread-416::DEBUG::2013-12-12 13:45:15,520::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-416::DEBUG::2013-12-12 13:45:15,521::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-416::DEBUG::2013-12-12 13:45:15,521::task::974::TaskManager.Task::(_decref) Task=`5b4b013f-afb5-4fd5-bce8-644505774a7b`::ref 0 aborting False >Thread-422::DEBUG::2013-12-12 13:45:30,650::task::579::TaskManager.Task::(_updateState) Task=`d02ae2ca-602c-4ec2-8c4e-61f96d4c4f5f`::moving from state init -> state preparing >Thread-422::INFO::2013-12-12 13:45:30,650::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-422::INFO::2013-12-12 13:45:30,650::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-422::DEBUG::2013-12-12 13:45:30,651::task::1168::TaskManager.Task::(prepare) Task=`d02ae2ca-602c-4ec2-8c4e-61f96d4c4f5f`::finished: {} >Thread-422::DEBUG::2013-12-12 13:45:30,651::task::579::TaskManager.Task::(_updateState) Task=`d02ae2ca-602c-4ec2-8c4e-61f96d4c4f5f`::moving from state preparing -> state finished >Thread-422::DEBUG::2013-12-12 13:45:30,651::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-422::DEBUG::2013-12-12 13:45:30,651::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-422::DEBUG::2013-12-12 13:45:30,651::task::974::TaskManager.Task::(_decref) Task=`d02ae2ca-602c-4ec2-8c4e-61f96d4c4f5f`::ref 0 aborting False >Thread-426::DEBUG::2013-12-12 13:45:39,615::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-426::DEBUG::2013-12-12 13:45:39,946::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-428::DEBUG::2013-12-12 13:45:39,957::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-428::DEBUG::2013-12-12 13:45:40,123::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-430::DEBUG::2013-12-12 13:45:45,748::task::579::TaskManager.Task::(_updateState) Task=`865efbda-0d0d-45ae-9073-903fc5bade3c`::moving from state init -> state preparing >Thread-430::INFO::2013-12-12 13:45:45,748::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-430::INFO::2013-12-12 13:45:45,748::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-430::DEBUG::2013-12-12 13:45:45,748::task::1168::TaskManager.Task::(prepare) Task=`865efbda-0d0d-45ae-9073-903fc5bade3c`::finished: {} >Thread-430::DEBUG::2013-12-12 13:45:45,749::task::579::TaskManager.Task::(_updateState) Task=`865efbda-0d0d-45ae-9073-903fc5bade3c`::moving from state preparing -> state finished >Thread-430::DEBUG::2013-12-12 13:45:45,749::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-430::DEBUG::2013-12-12 13:45:45,749::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-430::DEBUG::2013-12-12 13:45:45,749::task::974::TaskManager.Task::(_decref) Task=`865efbda-0d0d-45ae-9073-903fc5bade3c`::ref 0 aborting False >Thread-436::DEBUG::2013-12-12 13:45:59,243::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeStatus with ('StartMigrationDuringRebalanceTest', '', '') {} >Thread-436::DEBUG::2013-12-12 13:45:59,417::BindingXMLRPC::991::vds::(wrapper) return volumeStatus with {'volumeStatus': {'bricks': [{'status': 'ONLINE', 'brick': 'latest-a:/bricks/201312121333559771942637805', 'pid': '6101', 'port': '49152', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}, {'status': 'ONLINE', 'brick': 'latest-a:/bricks/20131212133357392850249563', 'pid': '6113', 'port': '49153', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}, {'status': 'ONLINE', 'brick': 'latest-a:/bricks/201312121333573941245056192', 'pid': '6124', 'port': '49154', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/20131212133357394550199115', 'pid': '5872', 'port': '49152', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/20131212133357395516730110', 'pid': '5883', 'port': '49153', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/201312121333573951287551485', 'pid': '5894', 'port': '49154', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/20131212133418659927299489', 'pid': '5905', 'port': '49155', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'brick': 'latest-a:/bricks/20131212133427138341374234', 'pid': '6136', 'port': '49155', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/20131212133434230219930446', 'pid': '5916', 'port': '49156', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'brick': 'latest-a:/bricks/201312121334434851151947411', 'pid': '6147', 'port': '49156', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}], 'nfs': [{'status': 'ONLINE', 'hostname': '10.14.16.127', 'pid': '5930', 'port': '2049', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'hostname': '10.14.16.132', 'pid': '6159', 'port': '2049', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}], 'shd': [], 'name': 'StartMigrationDuringRebalanceTest'}, 'status': {'message': 'Done', 'code': 0}} >Thread-437::DEBUG::2013-12-12 13:46:00,845::task::579::TaskManager.Task::(_updateState) Task=`61edbb3b-57e2-434d-8cac-d1f77320d35a`::moving from state init -> state preparing >Thread-437::INFO::2013-12-12 13:46:00,846::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-437::INFO::2013-12-12 13:46:00,846::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-437::DEBUG::2013-12-12 13:46:00,846::task::1168::TaskManager.Task::(prepare) Task=`61edbb3b-57e2-434d-8cac-d1f77320d35a`::finished: {} >Thread-437::DEBUG::2013-12-12 13:46:00,846::task::579::TaskManager.Task::(_updateState) Task=`61edbb3b-57e2-434d-8cac-d1f77320d35a`::moving from state preparing -> state finished >Thread-437::DEBUG::2013-12-12 13:46:00,846::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-437::DEBUG::2013-12-12 13:46:00,847::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-437::DEBUG::2013-12-12 13:46:00,847::task::974::TaskManager.Task::(_decref) Task=`61edbb3b-57e2-434d-8cac-d1f77320d35a`::ref 0 aborting False >Thread-439::DEBUG::2013-12-12 13:46:01,249::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-439::DEBUG::2013-12-12 13:46:01,423::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-440::DEBUG::2013-12-12 13:46:01,758::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} flowID [44ea9dad] >Thread-440::DEBUG::2013-12-12 13:46:02,089::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-441::DEBUG::2013-12-12 13:46:02,099::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} flowID [44ea9dad] >Thread-441::DEBUG::2013-12-12 13:46:02,270::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-443::DEBUG::2013-12-12 13:46:07,295::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-443::DEBUG::2013-12-12 13:46:07,633::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-445::DEBUG::2013-12-12 13:46:07,641::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-445::DEBUG::2013-12-12 13:46:07,807::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-448::DEBUG::2013-12-12 13:46:16,405::task::579::TaskManager.Task::(_updateState) Task=`b432d4cc-fc44-457e-b78d-1bc77296f367`::moving from state init -> state preparing >Thread-448::INFO::2013-12-12 13:46:16,406::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-448::INFO::2013-12-12 13:46:16,406::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-448::DEBUG::2013-12-12 13:46:16,406::task::1168::TaskManager.Task::(prepare) Task=`b432d4cc-fc44-457e-b78d-1bc77296f367`::finished: {} >Thread-448::DEBUG::2013-12-12 13:46:16,406::task::579::TaskManager.Task::(_updateState) Task=`b432d4cc-fc44-457e-b78d-1bc77296f367`::moving from state preparing -> state finished >Thread-448::DEBUG::2013-12-12 13:46:16,406::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-448::DEBUG::2013-12-12 13:46:16,406::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-448::DEBUG::2013-12-12 13:46:16,407::task::974::TaskManager.Task::(_decref) Task=`b432d4cc-fc44-457e-b78d-1bc77296f367`::ref 0 aborting False >Thread-452::DEBUG::2013-12-12 13:46:23,959::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-452::DEBUG::2013-12-12 13:46:24,293::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-453::DEBUG::2013-12-12 13:46:24,301::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-453::DEBUG::2013-12-12 13:46:24,468::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-456::DEBUG::2013-12-12 13:46:31,500::task::579::TaskManager.Task::(_updateState) Task=`3f37cf6a-44ab-4b26-b19b-a5182790c4bd`::moving from state init -> state preparing >Thread-456::INFO::2013-12-12 13:46:31,500::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-456::INFO::2013-12-12 13:46:31,500::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-456::DEBUG::2013-12-12 13:46:31,500::task::1168::TaskManager.Task::(prepare) Task=`3f37cf6a-44ab-4b26-b19b-a5182790c4bd`::finished: {} >Thread-456::DEBUG::2013-12-12 13:46:31,500::task::579::TaskManager.Task::(_updateState) Task=`3f37cf6a-44ab-4b26-b19b-a5182790c4bd`::moving from state preparing -> state finished >Thread-456::DEBUG::2013-12-12 13:46:31,501::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-456::DEBUG::2013-12-12 13:46:31,501::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-456::DEBUG::2013-12-12 13:46:31,501::task::974::TaskManager.Task::(_decref) Task=`3f37cf6a-44ab-4b26-b19b-a5182790c4bd`::ref 0 aborting False >Thread-460::DEBUG::2013-12-12 13:46:40,541::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-460::DEBUG::2013-12-12 13:46:40,870::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-462::DEBUG::2013-12-12 13:46:40,877::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-462::DEBUG::2013-12-12 13:46:41,041::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-464::DEBUG::2013-12-12 13:46:46,062::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-464::DEBUG::2013-12-12 13:46:46,391::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-465::DEBUG::2013-12-12 13:46:46,399::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-465::DEBUG::2013-12-12 13:46:46,563::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-466::DEBUG::2013-12-12 13:46:46,588::task::579::TaskManager.Task::(_updateState) Task=`e1e6812b-e46a-4490-85f0-930d761b77da`::moving from state init -> state preparing >Thread-466::INFO::2013-12-12 13:46:46,589::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-466::INFO::2013-12-12 13:46:46,589::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-466::DEBUG::2013-12-12 13:46:46,589::task::1168::TaskManager.Task::(prepare) Task=`e1e6812b-e46a-4490-85f0-930d761b77da`::finished: {} >Thread-466::DEBUG::2013-12-12 13:46:46,589::task::579::TaskManager.Task::(_updateState) Task=`e1e6812b-e46a-4490-85f0-930d761b77da`::moving from state preparing -> state finished >Thread-466::DEBUG::2013-12-12 13:46:46,589::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-466::DEBUG::2013-12-12 13:46:46,590::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-466::DEBUG::2013-12-12 13:46:46,590::task::974::TaskManager.Task::(_decref) Task=`e1e6812b-e46a-4490-85f0-930d761b77da`::ref 0 aborting False >Thread-469::DEBUG::2013-12-12 13:46:51,584::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-469::DEBUG::2013-12-12 13:46:51,912::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-470::DEBUG::2013-12-12 13:46:51,919::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-470::DEBUG::2013-12-12 13:46:52,085::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-474::DEBUG::2013-12-12 13:47:01,678::task::579::TaskManager.Task::(_updateState) Task=`c6632d6f-2279-4053-b622-a7c6f621d04a`::moving from state init -> state preparing >Thread-474::INFO::2013-12-12 13:47:01,678::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-474::INFO::2013-12-12 13:47:01,679::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-474::DEBUG::2013-12-12 13:47:01,679::task::1168::TaskManager.Task::(prepare) Task=`c6632d6f-2279-4053-b622-a7c6f621d04a`::finished: {} >Thread-474::DEBUG::2013-12-12 13:47:01,679::task::579::TaskManager.Task::(_updateState) Task=`c6632d6f-2279-4053-b622-a7c6f621d04a`::moving from state preparing -> state finished >Thread-474::DEBUG::2013-12-12 13:47:01,679::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-474::DEBUG::2013-12-12 13:47:01,679::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-474::DEBUG::2013-12-12 13:47:01,679::task::974::TaskManager.Task::(_decref) Task=`c6632d6f-2279-4053-b622-a7c6f621d04a`::ref 0 aborting False >Thread-480::DEBUG::2013-12-12 13:47:16,767::task::579::TaskManager.Task::(_updateState) Task=`feb3cf07-9e33-4c99-b94b-4bb60929aead`::moving from state init -> state preparing >Thread-480::INFO::2013-12-12 13:47:16,767::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-480::INFO::2013-12-12 13:47:16,767::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-480::DEBUG::2013-12-12 13:47:16,767::task::1168::TaskManager.Task::(prepare) Task=`feb3cf07-9e33-4c99-b94b-4bb60929aead`::finished: {} >Thread-480::DEBUG::2013-12-12 13:47:16,767::task::579::TaskManager.Task::(_updateState) Task=`feb3cf07-9e33-4c99-b94b-4bb60929aead`::moving from state preparing -> state finished >Thread-480::DEBUG::2013-12-12 13:47:16,768::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-480::DEBUG::2013-12-12 13:47:16,768::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-480::DEBUG::2013-12-12 13:47:16,768::task::974::TaskManager.Task::(_decref) Task=`feb3cf07-9e33-4c99-b94b-4bb60929aead`::ref 0 aborting False >Thread-486::DEBUG::2013-12-12 13:47:30,293::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-486::DEBUG::2013-12-12 13:47:30,619::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-487::DEBUG::2013-12-12 13:47:30,626::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-487::DEBUG::2013-12-12 13:47:30,794::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-488::DEBUG::2013-12-12 13:47:31,853::task::579::TaskManager.Task::(_updateState) Task=`c42fb6c0-52a9-44cc-8ca4-604c07693bcc`::moving from state init -> state preparing >Thread-488::INFO::2013-12-12 13:47:31,854::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-488::INFO::2013-12-12 13:47:31,854::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-488::DEBUG::2013-12-12 13:47:31,854::task::1168::TaskManager.Task::(prepare) Task=`c42fb6c0-52a9-44cc-8ca4-604c07693bcc`::finished: {} >Thread-488::DEBUG::2013-12-12 13:47:31,854::task::579::TaskManager.Task::(_updateState) Task=`c42fb6c0-52a9-44cc-8ca4-604c07693bcc`::moving from state preparing -> state finished >Thread-488::DEBUG::2013-12-12 13:47:31,854::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-488::DEBUG::2013-12-12 13:47:31,854::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-488::DEBUG::2013-12-12 13:47:31,855::task::974::TaskManager.Task::(_decref) Task=`c42fb6c0-52a9-44cc-8ca4-604c07693bcc`::ref 0 aborting False >Thread-491::DEBUG::2013-12-12 13:47:35,814::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-491::DEBUG::2013-12-12 13:47:36,141::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-492::DEBUG::2013-12-12 13:47:36,149::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-492::DEBUG::2013-12-12 13:47:36,319::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-496::DEBUG::2013-12-12 13:47:46,939::task::579::TaskManager.Task::(_updateState) Task=`8fa1c062-6c45-4a39-bf79-2305f70ba4ca`::moving from state init -> state preparing >Thread-496::INFO::2013-12-12 13:47:46,940::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-496::INFO::2013-12-12 13:47:46,940::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-496::DEBUG::2013-12-12 13:47:46,940::task::1168::TaskManager.Task::(prepare) Task=`8fa1c062-6c45-4a39-bf79-2305f70ba4ca`::finished: {} >Thread-496::DEBUG::2013-12-12 13:47:46,940::task::579::TaskManager.Task::(_updateState) Task=`8fa1c062-6c45-4a39-bf79-2305f70ba4ca`::moving from state preparing -> state finished >Thread-496::DEBUG::2013-12-12 13:47:46,941::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-496::DEBUG::2013-12-12 13:47:46,941::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-496::DEBUG::2013-12-12 13:47:46,941::task::974::TaskManager.Task::(_decref) Task=`8fa1c062-6c45-4a39-bf79-2305f70ba4ca`::ref 0 aborting False >Thread-499::DEBUG::2013-12-12 13:47:52,398::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-499::DEBUG::2013-12-12 13:47:52,727::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-500::DEBUG::2013-12-12 13:47:52,735::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-500::DEBUG::2013-12-12 13:47:52,901::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-503::DEBUG::2013-12-12 13:47:57,922::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-503::DEBUG::2013-12-12 13:47:58,253::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-504::DEBUG::2013-12-12 13:47:58,261::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-504::DEBUG::2013-12-12 13:47:58,428::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-506::DEBUG::2013-12-12 13:48:01,621::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-506::DEBUG::2013-12-12 13:48:01,793::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-507::DEBUG::2013-12-12 13:48:02,064::task::579::TaskManager.Task::(_updateState) Task=`6e37d014-b9b4-4c3d-8ce3-d89214213c42`::moving from state init -> state preparing >Thread-507::INFO::2013-12-12 13:48:02,064::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-507::INFO::2013-12-12 13:48:02,064::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-507::DEBUG::2013-12-12 13:48:02,064::task::1168::TaskManager.Task::(prepare) Task=`6e37d014-b9b4-4c3d-8ce3-d89214213c42`::finished: {} >Thread-507::DEBUG::2013-12-12 13:48:02,064::task::579::TaskManager.Task::(_updateState) Task=`6e37d014-b9b4-4c3d-8ce3-d89214213c42`::moving from state preparing -> state finished >Thread-507::DEBUG::2013-12-12 13:48:02,064::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-507::DEBUG::2013-12-12 13:48:02,065::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-507::DEBUG::2013-12-12 13:48:02,065::task::974::TaskManager.Task::(_decref) Task=`6e37d014-b9b4-4c3d-8ce3-d89214213c42`::ref 0 aborting False >Thread-509::DEBUG::2013-12-12 13:48:03,450::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-509::DEBUG::2013-12-12 13:48:03,783::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-510::DEBUG::2013-12-12 13:48:03,796::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-510::DEBUG::2013-12-12 13:48:03,960::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-515::DEBUG::2013-12-12 13:48:17,153::task::579::TaskManager.Task::(_updateState) Task=`26f3b559-dcad-4ad3-977b-22e488cec9ff`::moving from state init -> state preparing >Thread-515::INFO::2013-12-12 13:48:17,153::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-515::INFO::2013-12-12 13:48:17,153::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-515::DEBUG::2013-12-12 13:48:17,153::task::1168::TaskManager.Task::(prepare) Task=`26f3b559-dcad-4ad3-977b-22e488cec9ff`::finished: {} >Thread-515::DEBUG::2013-12-12 13:48:17,153::task::579::TaskManager.Task::(_updateState) Task=`26f3b559-dcad-4ad3-977b-22e488cec9ff`::moving from state preparing -> state finished >Thread-515::DEBUG::2013-12-12 13:48:17,153::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-515::DEBUG::2013-12-12 13:48:17,154::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-515::DEBUG::2013-12-12 13:48:17,154::task::974::TaskManager.Task::(_decref) Task=`26f3b559-dcad-4ad3-977b-22e488cec9ff`::ref 0 aborting False >Thread-517::DEBUG::2013-12-12 13:48:20,047::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-517::DEBUG::2013-12-12 13:48:20,381::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-519::DEBUG::2013-12-12 13:48:20,389::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-519::DEBUG::2013-12-12 13:48:20,555::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-521::DEBUG::2013-12-12 13:48:25,576::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-521::DEBUG::2013-12-12 13:48:25,913::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-522::DEBUG::2013-12-12 13:48:25,922::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-522::DEBUG::2013-12-12 13:48:26,088::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-525::DEBUG::2013-12-12 13:48:32,243::task::579::TaskManager.Task::(_updateState) Task=`3a373fb0-f572-45e9-bca4-5bf455b148c0`::moving from state init -> state preparing >Thread-525::INFO::2013-12-12 13:48:32,244::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-525::INFO::2013-12-12 13:48:32,244::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-525::DEBUG::2013-12-12 13:48:32,244::task::1168::TaskManager.Task::(prepare) Task=`3a373fb0-f572-45e9-bca4-5bf455b148c0`::finished: {} >Thread-525::DEBUG::2013-12-12 13:48:32,244::task::579::TaskManager.Task::(_updateState) Task=`3a373fb0-f572-45e9-bca4-5bf455b148c0`::moving from state preparing -> state finished >Thread-525::DEBUG::2013-12-12 13:48:32,244::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-525::DEBUG::2013-12-12 13:48:32,244::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-525::DEBUG::2013-12-12 13:48:32,245::task::974::TaskManager.Task::(_decref) Task=`3a373fb0-f572-45e9-bca4-5bf455b148c0`::ref 0 aborting False >Thread-528::DEBUG::2013-12-12 13:48:36,638::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-528::DEBUG::2013-12-12 13:48:36,967::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-529::DEBUG::2013-12-12 13:48:36,975::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-529::DEBUG::2013-12-12 13:48:37,143::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-532::DEBUG::2013-12-12 13:48:42,166::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-532::DEBUG::2013-12-12 13:48:42,495::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-533::DEBUG::2013-12-12 13:48:42,509::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-533::DEBUG::2013-12-12 13:48:42,676::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-535::DEBUG::2013-12-12 13:48:47,346::task::579::TaskManager.Task::(_updateState) Task=`daee12f5-42f3-47d3-8d82-d3104fdd6fe3`::moving from state init -> state preparing >Thread-535::INFO::2013-12-12 13:48:47,347::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-535::INFO::2013-12-12 13:48:47,347::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-535::DEBUG::2013-12-12 13:48:47,347::task::1168::TaskManager.Task::(prepare) Task=`daee12f5-42f3-47d3-8d82-d3104fdd6fe3`::finished: {} >Thread-535::DEBUG::2013-12-12 13:48:47,347::task::579::TaskManager.Task::(_updateState) Task=`daee12f5-42f3-47d3-8d82-d3104fdd6fe3`::moving from state preparing -> state finished >Thread-535::DEBUG::2013-12-12 13:48:47,347::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-535::DEBUG::2013-12-12 13:48:47,348::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-535::DEBUG::2013-12-12 13:48:47,348::task::974::TaskManager.Task::(_decref) Task=`daee12f5-42f3-47d3-8d82-d3104fdd6fe3`::ref 0 aborting False >Thread-537::DEBUG::2013-12-12 13:48:47,704::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-537::DEBUG::2013-12-12 13:48:48,030::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-538::DEBUG::2013-12-12 13:48:48,038::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-538::DEBUG::2013-12-12 13:48:48,204::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-542::DEBUG::2013-12-12 13:48:58,758::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-542::DEBUG::2013-12-12 13:48:59,088::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-543::DEBUG::2013-12-12 13:48:59,096::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-543::DEBUG::2013-12-12 13:48:59,264::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-545::DEBUG::2013-12-12 13:49:01,805::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-545::DEBUG::2013-12-12 13:49:01,979::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-546::DEBUG::2013-12-12 13:49:02,461::task::579::TaskManager.Task::(_updateState) Task=`a90a65a4-2fc2-4367-a581-a68f84898799`::moving from state init -> state preparing >Thread-546::INFO::2013-12-12 13:49:02,462::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-546::INFO::2013-12-12 13:49:02,462::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-546::DEBUG::2013-12-12 13:49:02,462::task::1168::TaskManager.Task::(prepare) Task=`a90a65a4-2fc2-4367-a581-a68f84898799`::finished: {} >Thread-546::DEBUG::2013-12-12 13:49:02,462::task::579::TaskManager.Task::(_updateState) Task=`a90a65a4-2fc2-4367-a581-a68f84898799`::moving from state preparing -> state finished >Thread-546::DEBUG::2013-12-12 13:49:02,462::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-546::DEBUG::2013-12-12 13:49:02,462::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-546::DEBUG::2013-12-12 13:49:02,463::task::974::TaskManager.Task::(_decref) Task=`a90a65a4-2fc2-4367-a581-a68f84898799`::ref 0 aborting False >Thread-548::DEBUG::2013-12-12 13:49:04,302::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-548::DEBUG::2013-12-12 13:49:04,631::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-549::DEBUG::2013-12-12 13:49:04,642::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-549::DEBUG::2013-12-12 13:49:04,807::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-554::DEBUG::2013-12-12 13:49:17,545::task::579::TaskManager.Task::(_updateState) Task=`9994bd81-7a56-4673-8df2-0e3560077b52`::moving from state init -> state preparing >Thread-554::INFO::2013-12-12 13:49:17,546::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-554::INFO::2013-12-12 13:49:17,546::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-554::DEBUG::2013-12-12 13:49:17,546::task::1168::TaskManager.Task::(prepare) Task=`9994bd81-7a56-4673-8df2-0e3560077b52`::finished: {} >Thread-554::DEBUG::2013-12-12 13:49:17,546::task::579::TaskManager.Task::(_updateState) Task=`9994bd81-7a56-4673-8df2-0e3560077b52`::moving from state preparing -> state finished >Thread-554::DEBUG::2013-12-12 13:49:17,546::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-554::DEBUG::2013-12-12 13:49:17,546::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-554::DEBUG::2013-12-12 13:49:17,547::task::974::TaskManager.Task::(_decref) Task=`9994bd81-7a56-4673-8df2-0e3560077b52`::ref 0 aborting False >Thread-557::DEBUG::2013-12-12 13:49:20,886::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-557::DEBUG::2013-12-12 13:49:21,221::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-558::DEBUG::2013-12-12 13:49:21,229::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-558::DEBUG::2013-12-12 13:49:21,396::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-562::DEBUG::2013-12-12 13:49:31,936::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-562::DEBUG::2013-12-12 13:49:32,268::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-563::DEBUG::2013-12-12 13:49:32,276::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-563::DEBUG::2013-12-12 13:49:32,446::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-564::DEBUG::2013-12-12 13:49:32,659::task::579::TaskManager.Task::(_updateState) Task=`1cad0ce9-1925-4630-be3b-614202a378b8`::moving from state init -> state preparing >Thread-564::INFO::2013-12-12 13:49:32,659::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-564::INFO::2013-12-12 13:49:32,659::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-564::DEBUG::2013-12-12 13:49:32,659::task::1168::TaskManager.Task::(prepare) Task=`1cad0ce9-1925-4630-be3b-614202a378b8`::finished: {} >Thread-564::DEBUG::2013-12-12 13:49:32,659::task::579::TaskManager.Task::(_updateState) Task=`1cad0ce9-1925-4630-be3b-614202a378b8`::moving from state preparing -> state finished >Thread-564::DEBUG::2013-12-12 13:49:32,660::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-564::DEBUG::2013-12-12 13:49:32,660::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-564::DEBUG::2013-12-12 13:49:32,660::task::974::TaskManager.Task::(_decref) Task=`1cad0ce9-1925-4630-be3b-614202a378b8`::ref 0 aborting False >Thread-567::DEBUG::2013-12-12 13:49:37,469::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-567::DEBUG::2013-12-12 13:49:37,797::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-568::DEBUG::2013-12-12 13:49:37,805::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-568::DEBUG::2013-12-12 13:49:37,971::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-571::DEBUG::2013-12-12 13:49:42,992::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-571::DEBUG::2013-12-12 13:49:43,321::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-572::DEBUG::2013-12-12 13:49:43,328::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-572::DEBUG::2013-12-12 13:49:43,494::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-574::DEBUG::2013-12-12 13:49:47,748::task::579::TaskManager.Task::(_updateState) Task=`167ac8e8-8be1-4192-aae5-51086b8258a0`::moving from state init -> state preparing >Thread-574::INFO::2013-12-12 13:49:47,748::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-574::INFO::2013-12-12 13:49:47,749::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-574::DEBUG::2013-12-12 13:49:47,749::task::1168::TaskManager.Task::(prepare) Task=`167ac8e8-8be1-4192-aae5-51086b8258a0`::finished: {} >Thread-574::DEBUG::2013-12-12 13:49:47,749::task::579::TaskManager.Task::(_updateState) Task=`167ac8e8-8be1-4192-aae5-51086b8258a0`::moving from state preparing -> state finished >Thread-574::DEBUG::2013-12-12 13:49:47,749::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-574::DEBUG::2013-12-12 13:49:47,749::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-574::DEBUG::2013-12-12 13:49:47,750::task::974::TaskManager.Task::(_decref) Task=`167ac8e8-8be1-4192-aae5-51086b8258a0`::ref 0 aborting False >Thread-576::DEBUG::2013-12-12 13:49:48,515::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-576::DEBUG::2013-12-12 13:49:48,847::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-577::DEBUG::2013-12-12 13:49:48,854::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-577::DEBUG::2013-12-12 13:49:49,019::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-582::DEBUG::2013-12-12 13:50:02,840::task::579::TaskManager.Task::(_updateState) Task=`2fc27a13-1b81-4c9d-a685-46e70f7c12fd`::moving from state init -> state preparing >Thread-582::INFO::2013-12-12 13:50:02,840::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-582::INFO::2013-12-12 13:50:02,841::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-582::DEBUG::2013-12-12 13:50:02,841::task::1168::TaskManager.Task::(prepare) Task=`2fc27a13-1b81-4c9d-a685-46e70f7c12fd`::finished: {} >Thread-582::DEBUG::2013-12-12 13:50:02,841::task::579::TaskManager.Task::(_updateState) Task=`2fc27a13-1b81-4c9d-a685-46e70f7c12fd`::moving from state preparing -> state finished >Thread-582::DEBUG::2013-12-12 13:50:02,841::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-582::DEBUG::2013-12-12 13:50:02,841::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-582::DEBUG::2013-12-12 13:50:02,841::task::974::TaskManager.Task::(_decref) Task=`2fc27a13-1b81-4c9d-a685-46e70f7c12fd`::ref 0 aborting False >Thread-584::DEBUG::2013-12-12 13:50:05,111::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-584::DEBUG::2013-12-12 13:50:05,441::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-585::DEBUG::2013-12-12 13:50:05,449::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-585::DEBUG::2013-12-12 13:50:05,616::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-590::DEBUG::2013-12-12 13:50:17,927::task::579::TaskManager.Task::(_updateState) Task=`4146babd-45dc-4771-a235-0ef6b652c686`::moving from state init -> state preparing >Thread-590::INFO::2013-12-12 13:50:17,927::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-590::INFO::2013-12-12 13:50:17,928::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-590::DEBUG::2013-12-12 13:50:17,928::task::1168::TaskManager.Task::(prepare) Task=`4146babd-45dc-4771-a235-0ef6b652c686`::finished: {} >Thread-590::DEBUG::2013-12-12 13:50:17,928::task::579::TaskManager.Task::(_updateState) Task=`4146babd-45dc-4771-a235-0ef6b652c686`::moving from state preparing -> state finished >Thread-590::DEBUG::2013-12-12 13:50:17,928::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-590::DEBUG::2013-12-12 13:50:17,928::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-590::DEBUG::2013-12-12 13:50:17,928::task::974::TaskManager.Task::(_decref) Task=`4146babd-45dc-4771-a235-0ef6b652c686`::ref 0 aborting False >Thread-595::DEBUG::2013-12-12 13:50:27,207::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-595::DEBUG::2013-12-12 13:50:27,542::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-596::DEBUG::2013-12-12 13:50:27,549::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-596::DEBUG::2013-12-12 13:50:27,715::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-598::DEBUG::2013-12-12 13:50:33,042::task::579::TaskManager.Task::(_updateState) Task=`6a4fcdd5-a4d6-42c5-81ee-76c2d0f37012`::moving from state init -> state preparing >Thread-598::INFO::2013-12-12 13:50:33,042::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-598::INFO::2013-12-12 13:50:33,042::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-598::DEBUG::2013-12-12 13:50:33,042::task::1168::TaskManager.Task::(prepare) Task=`6a4fcdd5-a4d6-42c5-81ee-76c2d0f37012`::finished: {} >Thread-598::DEBUG::2013-12-12 13:50:33,043::task::579::TaskManager.Task::(_updateState) Task=`6a4fcdd5-a4d6-42c5-81ee-76c2d0f37012`::moving from state preparing -> state finished >Thread-598::DEBUG::2013-12-12 13:50:33,043::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-598::DEBUG::2013-12-12 13:50:33,043::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-598::DEBUG::2013-12-12 13:50:33,043::task::974::TaskManager.Task::(_decref) Task=`6a4fcdd5-a4d6-42c5-81ee-76c2d0f37012`::ref 0 aborting False >Thread-603::DEBUG::2013-12-12 13:50:43,795::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-603::DEBUG::2013-12-12 13:50:44,125::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-604::DEBUG::2013-12-12 13:50:44,133::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-604::DEBUG::2013-12-12 13:50:44,298::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-606::DEBUG::2013-12-12 13:50:48,136::task::579::TaskManager.Task::(_updateState) Task=`f09335fc-59ed-45ac-8d7f-aca35d6bf20c`::moving from state init -> state preparing >Thread-606::INFO::2013-12-12 13:50:48,137::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-606::INFO::2013-12-12 13:50:48,137::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-606::DEBUG::2013-12-12 13:50:48,137::task::1168::TaskManager.Task::(prepare) Task=`f09335fc-59ed-45ac-8d7f-aca35d6bf20c`::finished: {} >Thread-606::DEBUG::2013-12-12 13:50:48,137::task::579::TaskManager.Task::(_updateState) Task=`f09335fc-59ed-45ac-8d7f-aca35d6bf20c`::moving from state preparing -> state finished >Thread-606::DEBUG::2013-12-12 13:50:48,137::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-606::DEBUG::2013-12-12 13:50:48,138::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-606::DEBUG::2013-12-12 13:50:48,138::task::974::TaskManager.Task::(_decref) Task=`f09335fc-59ed-45ac-8d7f-aca35d6bf20c`::ref 0 aborting False >Thread-608::DEBUG::2013-12-12 13:50:49,327::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-608::DEBUG::2013-12-12 13:50:49,654::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-609::DEBUG::2013-12-12 13:50:49,662::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-609::DEBUG::2013-12-12 13:50:49,828::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-612::DEBUG::2013-12-12 13:50:54,849::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-612::DEBUG::2013-12-12 13:50:55,177::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-613::DEBUG::2013-12-12 13:50:55,184::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-613::DEBUG::2013-12-12 13:50:55,351::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-615::DEBUG::2013-12-12 13:50:59,435::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeStatus with ('StartMigrationDuringRebalanceTest', '', '') {} >Thread-615::DEBUG::2013-12-12 13:50:59,611::BindingXMLRPC::991::vds::(wrapper) return volumeStatus with {'volumeStatus': {'bricks': [{'status': 'ONLINE', 'brick': 'latest-a:/bricks/201312121333559771942637805', 'pid': '6101', 'port': '49152', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}, {'status': 'ONLINE', 'brick': 'latest-a:/bricks/20131212133357392850249563', 'pid': '6113', 'port': '49153', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}, {'status': 'ONLINE', 'brick': 'latest-a:/bricks/201312121333573941245056192', 'pid': '6124', 'port': '49154', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/20131212133357394550199115', 'pid': '5872', 'port': '49152', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/20131212133357395516730110', 'pid': '5883', 'port': '49153', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/201312121333573951287551485', 'pid': '5894', 'port': '49154', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/20131212133418659927299489', 'pid': '5905', 'port': '49155', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'brick': 'latest-a:/bricks/20131212133427138341374234', 'pid': '6136', 'port': '49155', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/20131212133434230219930446', 'pid': '5916', 'port': '49156', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'brick': 'latest-a:/bricks/201312121334434851151947411', 'pid': '6147', 'port': '49156', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}], 'nfs': [{'status': 'ONLINE', 'hostname': '10.14.16.127', 'pid': '5930', 'port': '2049', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'hostname': '10.14.16.132', 'pid': '6159', 'port': '2049', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}], 'shd': [], 'name': 'StartMigrationDuringRebalanceTest'}, 'status': {'message': 'Done', 'code': 0}} >Thread-617::DEBUG::2013-12-12 13:51:00,372::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-617::DEBUG::2013-12-12 13:51:00,702::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-618::DEBUG::2013-12-12 13:51:00,709::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-618::DEBUG::2013-12-12 13:51:00,873::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-619::DEBUG::2013-12-12 13:51:02,179::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-619::DEBUG::2013-12-12 13:51:02,351::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-620::DEBUG::2013-12-12 13:51:03,222::task::579::TaskManager.Task::(_updateState) Task=`fc380ffc-57da-436c-9e4a-d6ec531db5b8`::moving from state init -> state preparing >Thread-620::INFO::2013-12-12 13:51:03,223::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-620::INFO::2013-12-12 13:51:03,223::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-620::DEBUG::2013-12-12 13:51:03,223::task::1168::TaskManager.Task::(prepare) Task=`fc380ffc-57da-436c-9e4a-d6ec531db5b8`::finished: {} >Thread-620::DEBUG::2013-12-12 13:51:03,223::task::579::TaskManager.Task::(_updateState) Task=`fc380ffc-57da-436c-9e4a-d6ec531db5b8`::moving from state preparing -> state finished >Thread-620::DEBUG::2013-12-12 13:51:03,223::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-620::DEBUG::2013-12-12 13:51:03,223::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-620::DEBUG::2013-12-12 13:51:03,224::task::974::TaskManager.Task::(_decref) Task=`fc380ffc-57da-436c-9e4a-d6ec531db5b8`::ref 0 aborting False >Thread-622::DEBUG::2013-12-12 13:51:05,894::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-622::DEBUG::2013-12-12 13:51:06,227::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-623::DEBUG::2013-12-12 13:51:06,234::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-623::DEBUG::2013-12-12 13:51:06,403::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-628::DEBUG::2013-12-12 13:51:16,947::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-628::DEBUG::2013-12-12 13:51:17,275::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-629::DEBUG::2013-12-12 13:51:17,288::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-629::DEBUG::2013-12-12 13:51:17,453::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-630::DEBUG::2013-12-12 13:51:18,313::task::579::TaskManager.Task::(_updateState) Task=`f94499ed-b045-4bdc-890a-b213cf02ee93`::moving from state init -> state preparing >Thread-630::INFO::2013-12-12 13:51:18,313::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-630::INFO::2013-12-12 13:51:18,313::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-630::DEBUG::2013-12-12 13:51:18,314::task::1168::TaskManager.Task::(prepare) Task=`f94499ed-b045-4bdc-890a-b213cf02ee93`::finished: {} >Thread-630::DEBUG::2013-12-12 13:51:18,314::task::579::TaskManager.Task::(_updateState) Task=`f94499ed-b045-4bdc-890a-b213cf02ee93`::moving from state preparing -> state finished >Thread-630::DEBUG::2013-12-12 13:51:18,314::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-630::DEBUG::2013-12-12 13:51:18,314::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-630::DEBUG::2013-12-12 13:51:18,314::task::974::TaskManager.Task::(_decref) Task=`f94499ed-b045-4bdc-890a-b213cf02ee93`::ref 0 aborting False >Thread-633::DEBUG::2013-12-12 13:51:22,479::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-633::DEBUG::2013-12-12 13:51:22,810::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-634::DEBUG::2013-12-12 13:51:22,818::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-634::DEBUG::2013-12-12 13:51:22,983::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-638::DEBUG::2013-12-12 13:51:33,414::task::579::TaskManager.Task::(_updateState) Task=`f36cb2eb-be6b-4579-b170-d8a9daa256fa`::moving from state init -> state preparing >Thread-638::INFO::2013-12-12 13:51:33,414::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-638::INFO::2013-12-12 13:51:33,414::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-638::DEBUG::2013-12-12 13:51:33,415::task::1168::TaskManager.Task::(prepare) Task=`f36cb2eb-be6b-4579-b170-d8a9daa256fa`::finished: {} >Thread-638::DEBUG::2013-12-12 13:51:33,415::task::579::TaskManager.Task::(_updateState) Task=`f36cb2eb-be6b-4579-b170-d8a9daa256fa`::moving from state preparing -> state finished >Thread-638::DEBUG::2013-12-12 13:51:33,415::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-638::DEBUG::2013-12-12 13:51:33,415::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-638::DEBUG::2013-12-12 13:51:33,415::task::974::TaskManager.Task::(_decref) Task=`f36cb2eb-be6b-4579-b170-d8a9daa256fa`::ref 0 aborting False >Thread-641::DEBUG::2013-12-12 13:51:39,057::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-641::DEBUG::2013-12-12 13:51:39,386::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-642::DEBUG::2013-12-12 13:51:39,393::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-642::DEBUG::2013-12-12 13:51:39,564::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-646::DEBUG::2013-12-12 13:51:48,500::task::579::TaskManager.Task::(_updateState) Task=`5b7217b1-303c-4385-ab96-b9448ad882ff`::moving from state init -> state preparing >Thread-646::INFO::2013-12-12 13:51:48,500::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-646::INFO::2013-12-12 13:51:48,501::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-646::DEBUG::2013-12-12 13:51:48,501::task::1168::TaskManager.Task::(prepare) Task=`5b7217b1-303c-4385-ab96-b9448ad882ff`::finished: {} >Thread-646::DEBUG::2013-12-12 13:51:48,501::task::579::TaskManager.Task::(_updateState) Task=`5b7217b1-303c-4385-ab96-b9448ad882ff`::moving from state preparing -> state finished >Thread-646::DEBUG::2013-12-12 13:51:48,501::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-646::DEBUG::2013-12-12 13:51:48,501::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-646::DEBUG::2013-12-12 13:51:48,501::task::974::TaskManager.Task::(_decref) Task=`5b7217b1-303c-4385-ab96-b9448ad882ff`::ref 0 aborting False >Thread-648::DEBUG::2013-12-12 13:51:50,119::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-648::DEBUG::2013-12-12 13:51:50,452::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-649::DEBUG::2013-12-12 13:51:50,459::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-649::DEBUG::2013-12-12 13:51:50,627::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-654::DEBUG::2013-12-12 13:52:02,362::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-654::DEBUG::2013-12-12 13:52:02,539::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-655::DEBUG::2013-12-12 13:52:03,584::task::579::TaskManager.Task::(_updateState) Task=`c54583d4-c15a-4ce0-8dca-83efd74278a7`::moving from state init -> state preparing >Thread-655::INFO::2013-12-12 13:52:03,584::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-655::INFO::2013-12-12 13:52:03,585::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-655::DEBUG::2013-12-12 13:52:03,585::task::1168::TaskManager.Task::(prepare) Task=`c54583d4-c15a-4ce0-8dca-83efd74278a7`::finished: {} >Thread-655::DEBUG::2013-12-12 13:52:03,585::task::579::TaskManager.Task::(_updateState) Task=`c54583d4-c15a-4ce0-8dca-83efd74278a7`::moving from state preparing -> state finished >Thread-655::DEBUG::2013-12-12 13:52:03,585::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-655::DEBUG::2013-12-12 13:52:03,585::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-655::DEBUG::2013-12-12 13:52:03,586::task::974::TaskManager.Task::(_decref) Task=`c54583d4-c15a-4ce0-8dca-83efd74278a7`::ref 0 aborting False >Thread-658::DEBUG::2013-12-12 13:52:06,698::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-658::DEBUG::2013-12-12 13:52:07,032::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-659::DEBUG::2013-12-12 13:52:07,039::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-659::DEBUG::2013-12-12 13:52:07,201::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-663::DEBUG::2013-12-12 13:52:17,756::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-663::DEBUG::2013-12-12 13:52:18,085::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-664::DEBUG::2013-12-12 13:52:18,092::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-664::DEBUG::2013-12-12 13:52:18,257::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-665::DEBUG::2013-12-12 13:52:18,682::task::579::TaskManager.Task::(_updateState) Task=`755c83d7-a205-41b6-b707-beaf0e152c23`::moving from state init -> state preparing >Thread-665::INFO::2013-12-12 13:52:18,682::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-665::INFO::2013-12-12 13:52:18,682::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-665::DEBUG::2013-12-12 13:52:18,682::task::1168::TaskManager.Task::(prepare) Task=`755c83d7-a205-41b6-b707-beaf0e152c23`::finished: {} >Thread-665::DEBUG::2013-12-12 13:52:18,682::task::579::TaskManager.Task::(_updateState) Task=`755c83d7-a205-41b6-b707-beaf0e152c23`::moving from state preparing -> state finished >Thread-665::DEBUG::2013-12-12 13:52:18,683::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-665::DEBUG::2013-12-12 13:52:18,683::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-665::DEBUG::2013-12-12 13:52:18,683::task::974::TaskManager.Task::(_decref) Task=`755c83d7-a205-41b6-b707-beaf0e152c23`::ref 0 aborting False >Thread-671::DEBUG::2013-12-12 13:52:33,772::task::579::TaskManager.Task::(_updateState) Task=`a421e51e-b043-4432-b372-24da58355590`::moving from state init -> state preparing >Thread-671::INFO::2013-12-12 13:52:33,772::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-671::INFO::2013-12-12 13:52:33,772::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-671::DEBUG::2013-12-12 13:52:33,772::task::1168::TaskManager.Task::(prepare) Task=`a421e51e-b043-4432-b372-24da58355590`::finished: {} >Thread-671::DEBUG::2013-12-12 13:52:33,772::task::579::TaskManager.Task::(_updateState) Task=`a421e51e-b043-4432-b372-24da58355590`::moving from state preparing -> state finished >Thread-671::DEBUG::2013-12-12 13:52:33,773::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-671::DEBUG::2013-12-12 13:52:33,773::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-671::DEBUG::2013-12-12 13:52:33,773::task::974::TaskManager.Task::(_decref) Task=`a421e51e-b043-4432-b372-24da58355590`::ref 0 aborting False >Thread-673::DEBUG::2013-12-12 13:52:34,344::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-673::DEBUG::2013-12-12 13:52:34,678::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-674::DEBUG::2013-12-12 13:52:34,685::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-674::DEBUG::2013-12-12 13:52:34,848::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-678::DEBUG::2013-12-12 13:52:45,392::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-678::DEBUG::2013-12-12 13:52:45,722::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-679::DEBUG::2013-12-12 13:52:45,734::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-679::DEBUG::2013-12-12 13:52:45,903::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-681::DEBUG::2013-12-12 13:52:48,871::task::579::TaskManager.Task::(_updateState) Task=`26838e71-5a16-40c6-9985-88d1c47839c6`::moving from state init -> state preparing >Thread-681::INFO::2013-12-12 13:52:48,871::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-681::INFO::2013-12-12 13:52:48,871::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-681::DEBUG::2013-12-12 13:52:48,871::task::1168::TaskManager.Task::(prepare) Task=`26838e71-5a16-40c6-9985-88d1c47839c6`::finished: {} >Thread-681::DEBUG::2013-12-12 13:52:48,872::task::579::TaskManager.Task::(_updateState) Task=`26838e71-5a16-40c6-9985-88d1c47839c6`::moving from state preparing -> state finished >Thread-681::DEBUG::2013-12-12 13:52:48,872::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-681::DEBUG::2013-12-12 13:52:48,872::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-681::DEBUG::2013-12-12 13:52:48,872::task::974::TaskManager.Task::(_decref) Task=`26838e71-5a16-40c6-9985-88d1c47839c6`::ref 0 aborting False >Thread-685::DEBUG::2013-12-12 13:52:56,480::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-685::DEBUG::2013-12-12 13:52:56,812::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-686::DEBUG::2013-12-12 13:52:56,821::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-686::DEBUG::2013-12-12 13:52:56,987::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-689::DEBUG::2013-12-12 13:53:02,009::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-689::DEBUG::2013-12-12 13:53:02,342::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-690::DEBUG::2013-12-12 13:53:02,350::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-690::DEBUG::2013-12-12 13:53:02,521::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-691::DEBUG::2013-12-12 13:53:02,553::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-691::DEBUG::2013-12-12 13:53:02,726::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-692::DEBUG::2013-12-12 13:53:03,959::task::579::TaskManager.Task::(_updateState) Task=`d4d232f6-8f63-491d-b959-f69fafd8e137`::moving from state init -> state preparing >Thread-692::INFO::2013-12-12 13:53:03,959::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-692::INFO::2013-12-12 13:53:03,959::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-692::DEBUG::2013-12-12 13:53:03,959::task::1168::TaskManager.Task::(prepare) Task=`d4d232f6-8f63-491d-b959-f69fafd8e137`::finished: {} >Thread-692::DEBUG::2013-12-12 13:53:03,959::task::579::TaskManager.Task::(_updateState) Task=`d4d232f6-8f63-491d-b959-f69fafd8e137`::moving from state preparing -> state finished >Thread-692::DEBUG::2013-12-12 13:53:03,960::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-692::DEBUG::2013-12-12 13:53:03,960::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-692::DEBUG::2013-12-12 13:53:03,960::task::974::TaskManager.Task::(_decref) Task=`d4d232f6-8f63-491d-b959-f69fafd8e137`::ref 0 aborting False >Thread-695::DEBUG::2013-12-12 13:53:07,543::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-695::DEBUG::2013-12-12 13:53:07,871::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-696::DEBUG::2013-12-12 13:53:07,879::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-696::DEBUG::2013-12-12 13:53:08,048::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-700::DEBUG::2013-12-12 13:53:18,597::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-700::DEBUG::2013-12-12 13:53:18,926::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-701::DEBUG::2013-12-12 13:53:18,935::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-702::DEBUG::2013-12-12 13:53:19,049::task::579::TaskManager.Task::(_updateState) Task=`2537846f-371a-4775-89ef-2db14579e560`::moving from state init -> state preparing >Thread-702::INFO::2013-12-12 13:53:19,049::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-702::INFO::2013-12-12 13:53:19,049::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-702::DEBUG::2013-12-12 13:53:19,050::task::1168::TaskManager.Task::(prepare) Task=`2537846f-371a-4775-89ef-2db14579e560`::finished: {} >Thread-702::DEBUG::2013-12-12 13:53:19,050::task::579::TaskManager.Task::(_updateState) Task=`2537846f-371a-4775-89ef-2db14579e560`::moving from state preparing -> state finished >Thread-702::DEBUG::2013-12-12 13:53:19,050::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-702::DEBUG::2013-12-12 13:53:19,050::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-702::DEBUG::2013-12-12 13:53:19,050::task::974::TaskManager.Task::(_decref) Task=`2537846f-371a-4775-89ef-2db14579e560`::ref 0 aborting False >Thread-701::DEBUG::2013-12-12 13:53:19,114::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-705::DEBUG::2013-12-12 13:53:24,135::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-705::DEBUG::2013-12-12 13:53:24,467::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-706::DEBUG::2013-12-12 13:53:24,474::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-706::DEBUG::2013-12-12 13:53:24,642::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-709::DEBUG::2013-12-12 13:53:29,667::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-709::DEBUG::2013-12-12 13:53:29,998::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-710::DEBUG::2013-12-12 13:53:30,005::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-710::DEBUG::2013-12-12 13:53:30,169::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-712::DEBUG::2013-12-12 13:53:34,130::task::579::TaskManager.Task::(_updateState) Task=`ebb46bd4-f33e-411c-ad6e-2e3d17f6c124`::moving from state init -> state preparing >Thread-712::INFO::2013-12-12 13:53:34,130::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-712::INFO::2013-12-12 13:53:34,131::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-712::DEBUG::2013-12-12 13:53:34,131::task::1168::TaskManager.Task::(prepare) Task=`ebb46bd4-f33e-411c-ad6e-2e3d17f6c124`::finished: {} >Thread-712::DEBUG::2013-12-12 13:53:34,131::task::579::TaskManager.Task::(_updateState) Task=`ebb46bd4-f33e-411c-ad6e-2e3d17f6c124`::moving from state preparing -> state finished >Thread-712::DEBUG::2013-12-12 13:53:34,131::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-712::DEBUG::2013-12-12 13:53:34,131::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-712::DEBUG::2013-12-12 13:53:34,131::task::974::TaskManager.Task::(_decref) Task=`ebb46bd4-f33e-411c-ad6e-2e3d17f6c124`::ref 0 aborting False >Thread-714::DEBUG::2013-12-12 13:53:35,190::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-714::DEBUG::2013-12-12 13:53:35,520::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-715::DEBUG::2013-12-12 13:53:35,527::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-715::DEBUG::2013-12-12 13:53:35,698::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-720::DEBUG::2013-12-12 13:53:46,244::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-720::DEBUG::2013-12-12 13:53:46,571::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-721::DEBUG::2013-12-12 13:53:46,579::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-721::DEBUG::2013-12-12 13:53:46,746::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-722::DEBUG::2013-12-12 13:53:49,220::task::579::TaskManager.Task::(_updateState) Task=`b5f2caf2-fd6f-42ad-a4ab-ae89400396b9`::moving from state init -> state preparing >Thread-722::INFO::2013-12-12 13:53:49,220::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-722::INFO::2013-12-12 13:53:49,220::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-722::DEBUG::2013-12-12 13:53:49,220::task::1168::TaskManager.Task::(prepare) Task=`b5f2caf2-fd6f-42ad-a4ab-ae89400396b9`::finished: {} >Thread-722::DEBUG::2013-12-12 13:53:49,221::task::579::TaskManager.Task::(_updateState) Task=`b5f2caf2-fd6f-42ad-a4ab-ae89400396b9`::moving from state preparing -> state finished >Thread-722::DEBUG::2013-12-12 13:53:49,221::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-722::DEBUG::2013-12-12 13:53:49,221::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-722::DEBUG::2013-12-12 13:53:49,221::task::974::TaskManager.Task::(_decref) Task=`b5f2caf2-fd6f-42ad-a4ab-ae89400396b9`::ref 0 aborting False >Thread-724::DEBUG::2013-12-12 13:53:51,786::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-724::DEBUG::2013-12-12 13:53:52,114::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-725::DEBUG::2013-12-12 13:53:52,121::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-725::DEBUG::2013-12-12 13:53:52,288::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-728::DEBUG::2013-12-12 13:53:57,323::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-728::DEBUG::2013-12-12 13:53:57,652::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-729::DEBUG::2013-12-12 13:53:57,661::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-729::DEBUG::2013-12-12 13:53:57,828::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-732::DEBUG::2013-12-12 13:54:02,737::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-732::DEBUG::2013-12-12 13:54:02,965::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-733::DEBUG::2013-12-12 13:54:04,547::task::579::TaskManager.Task::(_updateState) Task=`98d3f310-d273-4b85-ae0d-f3dc13423162`::moving from state init -> state preparing >Thread-733::INFO::2013-12-12 13:54:04,547::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-733::INFO::2013-12-12 13:54:04,547::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-733::DEBUG::2013-12-12 13:54:04,547::task::1168::TaskManager.Task::(prepare) Task=`98d3f310-d273-4b85-ae0d-f3dc13423162`::finished: {} >Thread-733::DEBUG::2013-12-12 13:54:04,548::task::579::TaskManager.Task::(_updateState) Task=`98d3f310-d273-4b85-ae0d-f3dc13423162`::moving from state preparing -> state finished >Thread-733::DEBUG::2013-12-12 13:54:04,548::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-733::DEBUG::2013-12-12 13:54:04,548::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-733::DEBUG::2013-12-12 13:54:04,548::task::974::TaskManager.Task::(_decref) Task=`98d3f310-d273-4b85-ae0d-f3dc13423162`::ref 0 aborting False >Thread-736::DEBUG::2013-12-12 13:54:08,385::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-736::DEBUG::2013-12-12 13:54:08,713::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-737::DEBUG::2013-12-12 13:54:08,722::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-737::DEBUG::2013-12-12 13:54:08,887::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-741::DEBUG::2013-12-12 13:54:19,434::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-742::DEBUG::2013-12-12 13:54:19,630::task::579::TaskManager.Task::(_updateState) Task=`3e1d58fc-8d5f-4b5d-a199-2a7277a3adc6`::moving from state init -> state preparing >Thread-742::INFO::2013-12-12 13:54:19,630::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-742::INFO::2013-12-12 13:54:19,631::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-742::DEBUG::2013-12-12 13:54:19,631::task::1168::TaskManager.Task::(prepare) Task=`3e1d58fc-8d5f-4b5d-a199-2a7277a3adc6`::finished: {} >Thread-742::DEBUG::2013-12-12 13:54:19,631::task::579::TaskManager.Task::(_updateState) Task=`3e1d58fc-8d5f-4b5d-a199-2a7277a3adc6`::moving from state preparing -> state finished >Thread-742::DEBUG::2013-12-12 13:54:19,631::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-742::DEBUG::2013-12-12 13:54:19,631::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-742::DEBUG::2013-12-12 13:54:19,632::task::974::TaskManager.Task::(_decref) Task=`3e1d58fc-8d5f-4b5d-a199-2a7277a3adc6`::ref 0 aborting False >Thread-741::DEBUG::2013-12-12 13:54:19,772::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-744::DEBUG::2013-12-12 13:54:19,780::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-744::DEBUG::2013-12-12 13:54:19,946::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-749::DEBUG::2013-12-12 13:54:34,710::task::579::TaskManager.Task::(_updateState) Task=`80df9d31-9a34-4292-a87d-89b210345367`::moving from state init -> state preparing >Thread-749::INFO::2013-12-12 13:54:34,710::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-749::INFO::2013-12-12 13:54:34,710::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-749::DEBUG::2013-12-12 13:54:34,710::task::1168::TaskManager.Task::(prepare) Task=`80df9d31-9a34-4292-a87d-89b210345367`::finished: {} >Thread-749::DEBUG::2013-12-12 13:54:34,710::task::579::TaskManager.Task::(_updateState) Task=`80df9d31-9a34-4292-a87d-89b210345367`::moving from state preparing -> state finished >Thread-749::DEBUG::2013-12-12 13:54:34,711::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-749::DEBUG::2013-12-12 13:54:34,711::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-749::DEBUG::2013-12-12 13:54:34,711::task::974::TaskManager.Task::(_decref) Task=`80df9d31-9a34-4292-a87d-89b210345367`::ref 0 aborting False >Thread-751::DEBUG::2013-12-12 13:54:36,024::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} flowID [44ea9dad] >Thread-751::DEBUG::2013-12-12 13:54:36,347::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-752::DEBUG::2013-12-12 13:54:36,354::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} flowID [44ea9dad] >Thread-752::DEBUG::2013-12-12 13:54:36,520::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-757::DEBUG::2013-12-12 13:54:47,063::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-757::DEBUG::2013-12-12 13:54:47,391::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-758::DEBUG::2013-12-12 13:54:47,399::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-758::DEBUG::2013-12-12 13:54:47,566::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-759::DEBUG::2013-12-12 13:54:49,799::task::579::TaskManager.Task::(_updateState) Task=`5115b4e2-faf9-4f96-9acd-c94ce894d0b2`::moving from state init -> state preparing >Thread-759::INFO::2013-12-12 13:54:49,799::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-759::INFO::2013-12-12 13:54:49,799::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-759::DEBUG::2013-12-12 13:54:49,800::task::1168::TaskManager.Task::(prepare) Task=`5115b4e2-faf9-4f96-9acd-c94ce894d0b2`::finished: {} >Thread-759::DEBUG::2013-12-12 13:54:49,800::task::579::TaskManager.Task::(_updateState) Task=`5115b4e2-faf9-4f96-9acd-c94ce894d0b2`::moving from state preparing -> state finished >Thread-759::DEBUG::2013-12-12 13:54:49,800::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-759::DEBUG::2013-12-12 13:54:49,800::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-759::DEBUG::2013-12-12 13:54:49,800::task::974::TaskManager.Task::(_decref) Task=`5115b4e2-faf9-4f96-9acd-c94ce894d0b2`::ref 0 aborting False >Thread-763::DEBUG::2013-12-12 13:54:58,118::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-763::DEBUG::2013-12-12 13:54:58,448::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-764::DEBUG::2013-12-12 13:54:58,455::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-764::DEBUG::2013-12-12 13:54:58,622::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-767::DEBUG::2013-12-12 13:55:03,643::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-767::DEBUG::2013-12-12 13:55:03,969::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-768::DEBUG::2013-12-12 13:55:03,975::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-768::DEBUG::2013-12-12 13:55:04,141::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-769::DEBUG::2013-12-12 13:55:04,886::task::579::TaskManager.Task::(_updateState) Task=`52324737-5535-4348-8255-1d204fb7bbee`::moving from state init -> state preparing >Thread-769::INFO::2013-12-12 13:55:04,886::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-769::INFO::2013-12-12 13:55:04,886::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-769::DEBUG::2013-12-12 13:55:04,886::task::1168::TaskManager.Task::(prepare) Task=`52324737-5535-4348-8255-1d204fb7bbee`::finished: {} >Thread-769::DEBUG::2013-12-12 13:55:04,887::task::579::TaskManager.Task::(_updateState) Task=`52324737-5535-4348-8255-1d204fb7bbee`::moving from state preparing -> state finished >Thread-769::DEBUG::2013-12-12 13:55:04,887::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-769::DEBUG::2013-12-12 13:55:04,887::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-769::DEBUG::2013-12-12 13:55:04,887::task::974::TaskManager.Task::(_decref) Task=`52324737-5535-4348-8255-1d204fb7bbee`::ref 0 aborting False >Thread-772::DEBUG::2013-12-12 13:55:09,161::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-772::DEBUG::2013-12-12 13:55:09,489::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-773::DEBUG::2013-12-12 13:55:09,497::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-773::DEBUG::2013-12-12 13:55:09,662::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-776::DEBUG::2013-12-12 13:55:14,683::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-776::DEBUG::2013-12-12 13:55:15,009::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-777::DEBUG::2013-12-12 13:55:15,016::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-777::DEBUG::2013-12-12 13:55:15,183::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-779::DEBUG::2013-12-12 13:55:19,981::task::579::TaskManager.Task::(_updateState) Task=`3f60f712-7db6-489b-b527-fc1ba12d883a`::moving from state init -> state preparing >Thread-779::INFO::2013-12-12 13:55:19,981::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-779::INFO::2013-12-12 13:55:19,981::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-779::DEBUG::2013-12-12 13:55:19,981::task::1168::TaskManager.Task::(prepare) Task=`3f60f712-7db6-489b-b527-fc1ba12d883a`::finished: {} >Thread-779::DEBUG::2013-12-12 13:55:19,982::task::579::TaskManager.Task::(_updateState) Task=`3f60f712-7db6-489b-b527-fc1ba12d883a`::moving from state preparing -> state finished >Thread-779::DEBUG::2013-12-12 13:55:19,982::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-779::DEBUG::2013-12-12 13:55:19,982::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-779::DEBUG::2013-12-12 13:55:19,982::task::974::TaskManager.Task::(_decref) Task=`3f60f712-7db6-489b-b527-fc1ba12d883a`::ref 0 aborting False >Thread-781::DEBUG::2013-12-12 13:55:20,216::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-781::DEBUG::2013-12-12 13:55:20,544::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-782::DEBUG::2013-12-12 13:55:20,552::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-782::DEBUG::2013-12-12 13:55:20,722::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-784::DEBUG::2013-12-12 13:55:25,745::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-784::DEBUG::2013-12-12 13:55:26,079::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-786::DEBUG::2013-12-12 13:55:26,086::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-786::DEBUG::2013-12-12 13:55:26,252::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-789::DEBUG::2013-12-12 13:55:35,064::task::579::TaskManager.Task::(_updateState) Task=`dcfaaa53-1479-4537-8d16-b7f96f5f08ac`::moving from state init -> state preparing >Thread-789::INFO::2013-12-12 13:55:35,064::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-789::INFO::2013-12-12 13:55:35,064::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-789::DEBUG::2013-12-12 13:55:35,064::task::1168::TaskManager.Task::(prepare) Task=`dcfaaa53-1479-4537-8d16-b7f96f5f08ac`::finished: {} >Thread-789::DEBUG::2013-12-12 13:55:35,065::task::579::TaskManager.Task::(_updateState) Task=`dcfaaa53-1479-4537-8d16-b7f96f5f08ac`::moving from state preparing -> state finished >Thread-789::DEBUG::2013-12-12 13:55:35,065::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-789::DEBUG::2013-12-12 13:55:35,065::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-789::DEBUG::2013-12-12 13:55:35,065::task::974::TaskManager.Task::(_decref) Task=`dcfaaa53-1479-4537-8d16-b7f96f5f08ac`::ref 0 aborting False >Thread-793::DEBUG::2013-12-12 13:55:42,317::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-793::DEBUG::2013-12-12 13:55:42,652::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-794::DEBUG::2013-12-12 13:55:42,660::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-794::DEBUG::2013-12-12 13:55:42,829::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-797::DEBUG::2013-12-12 13:55:50,141::task::579::TaskManager.Task::(_updateState) Task=`2d34b3a3-ccba-4b37-8864-ad4eb1706417`::moving from state init -> state preparing >Thread-797::INFO::2013-12-12 13:55:50,141::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-797::INFO::2013-12-12 13:55:50,141::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-797::DEBUG::2013-12-12 13:55:50,141::task::1168::TaskManager.Task::(prepare) Task=`2d34b3a3-ccba-4b37-8864-ad4eb1706417`::finished: {} >Thread-797::DEBUG::2013-12-12 13:55:50,141::task::579::TaskManager.Task::(_updateState) Task=`2d34b3a3-ccba-4b37-8864-ad4eb1706417`::moving from state preparing -> state finished >Thread-797::DEBUG::2013-12-12 13:55:50,142::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-797::DEBUG::2013-12-12 13:55:50,142::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-797::DEBUG::2013-12-12 13:55:50,142::task::974::TaskManager.Task::(_decref) Task=`2d34b3a3-ccba-4b37-8864-ad4eb1706417`::ref 0 aborting False >Thread-801::DEBUG::2013-12-12 13:55:58,902::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-801::DEBUG::2013-12-12 13:55:59,230::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-802::DEBUG::2013-12-12 13:55:59,238::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-802::DEBUG::2013-12-12 13:55:59,407::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-804::DEBUG::2013-12-12 13:55:59,629::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeStatus with ('StartMigrationDuringRebalanceTest', '', '') {} >Thread-804::DEBUG::2013-12-12 13:55:59,801::BindingXMLRPC::991::vds::(wrapper) return volumeStatus with {'volumeStatus': {'bricks': [{'status': 'ONLINE', 'brick': 'latest-a:/bricks/201312121333559771942637805', 'pid': '6101', 'port': '49152', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}, {'status': 'ONLINE', 'brick': 'latest-a:/bricks/20131212133357392850249563', 'pid': '6113', 'port': '49153', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}, {'status': 'ONLINE', 'brick': 'latest-a:/bricks/201312121333573941245056192', 'pid': '6124', 'port': '49154', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/20131212133357394550199115', 'pid': '5872', 'port': '49152', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/20131212133357395516730110', 'pid': '5883', 'port': '49153', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/201312121333573951287551485', 'pid': '5894', 'port': '49154', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/20131212133418659927299489', 'pid': '5905', 'port': '49155', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'brick': 'latest-a:/bricks/20131212133427138341374234', 'pid': '6136', 'port': '49155', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/20131212133434230219930446', 'pid': '5916', 'port': '49156', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'brick': 'latest-a:/bricks/201312121334434851151947411', 'pid': '6147', 'port': '49156', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}], 'nfs': [{'status': 'ONLINE', 'hostname': '10.14.16.127', 'pid': '5930', 'port': '2049', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'hostname': '10.14.16.132', 'pid': '6159', 'port': '2049', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}], 'shd': [], 'name': 'StartMigrationDuringRebalanceTest'}, 'status': {'message': 'Done', 'code': 0}} >Thread-806::DEBUG::2013-12-12 13:56:03,161::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-806::DEBUG::2013-12-12 13:56:03,333::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-807::DEBUG::2013-12-12 13:56:04,428::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-807::DEBUG::2013-12-12 13:56:04,758::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-808::DEBUG::2013-12-12 13:56:04,765::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-808::DEBUG::2013-12-12 13:56:04,932::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-809::DEBUG::2013-12-12 13:56:05,286::task::579::TaskManager.Task::(_updateState) Task=`c240b672-8af9-44dd-aead-1828bbc7fb2a`::moving from state init -> state preparing >Thread-809::INFO::2013-12-12 13:56:05,287::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-809::INFO::2013-12-12 13:56:05,287::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-809::DEBUG::2013-12-12 13:56:05,287::task::1168::TaskManager.Task::(prepare) Task=`c240b672-8af9-44dd-aead-1828bbc7fb2a`::finished: {} >Thread-809::DEBUG::2013-12-12 13:56:05,287::task::579::TaskManager.Task::(_updateState) Task=`c240b672-8af9-44dd-aead-1828bbc7fb2a`::moving from state preparing -> state finished >Thread-809::DEBUG::2013-12-12 13:56:05,287::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-809::DEBUG::2013-12-12 13:56:05,287::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-809::DEBUG::2013-12-12 13:56:05,288::task::974::TaskManager.Task::(_decref) Task=`c240b672-8af9-44dd-aead-1828bbc7fb2a`::ref 0 aborting False >Thread-812::DEBUG::2013-12-12 13:56:09,960::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-812::DEBUG::2013-12-12 13:56:10,286::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-813::DEBUG::2013-12-12 13:56:10,293::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-813::DEBUG::2013-12-12 13:56:10,458::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-817::DEBUG::2013-12-12 13:56:20,419::task::579::TaskManager.Task::(_updateState) Task=`180baa64-1049-4cf9-bb88-20e288a9fd90`::moving from state init -> state preparing >Thread-817::INFO::2013-12-12 13:56:20,419::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-817::INFO::2013-12-12 13:56:20,419::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-817::DEBUG::2013-12-12 13:56:20,420::task::1168::TaskManager.Task::(prepare) Task=`180baa64-1049-4cf9-bb88-20e288a9fd90`::finished: {} >Thread-817::DEBUG::2013-12-12 13:56:20,420::task::579::TaskManager.Task::(_updateState) Task=`180baa64-1049-4cf9-bb88-20e288a9fd90`::moving from state preparing -> state finished >Thread-817::DEBUG::2013-12-12 13:56:20,420::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-817::DEBUG::2013-12-12 13:56:20,420::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-817::DEBUG::2013-12-12 13:56:20,420::task::974::TaskManager.Task::(_decref) Task=`180baa64-1049-4cf9-bb88-20e288a9fd90`::ref 0 aborting False >Thread-822::DEBUG::2013-12-12 13:56:32,053::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-822::DEBUG::2013-12-12 13:56:32,379::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-823::DEBUG::2013-12-12 13:56:32,387::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-823::DEBUG::2013-12-12 13:56:32,557::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-825::DEBUG::2013-12-12 13:56:35,545::task::579::TaskManager.Task::(_updateState) Task=`b9c3baea-e01b-4bb6-a585-e909b9e78c20`::moving from state init -> state preparing >Thread-825::INFO::2013-12-12 13:56:35,545::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-825::INFO::2013-12-12 13:56:35,545::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-825::DEBUG::2013-12-12 13:56:35,545::task::1168::TaskManager.Task::(prepare) Task=`b9c3baea-e01b-4bb6-a585-e909b9e78c20`::finished: {} >Thread-825::DEBUG::2013-12-12 13:56:35,546::task::579::TaskManager.Task::(_updateState) Task=`b9c3baea-e01b-4bb6-a585-e909b9e78c20`::moving from state preparing -> state finished >Thread-825::DEBUG::2013-12-12 13:56:35,546::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-825::DEBUG::2013-12-12 13:56:35,546::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-825::DEBUG::2013-12-12 13:56:35,546::task::974::TaskManager.Task::(_decref) Task=`b9c3baea-e01b-4bb6-a585-e909b9e78c20`::ref 0 aborting False >Thread-829::DEBUG::2013-12-12 13:56:43,110::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-829::DEBUG::2013-12-12 13:56:43,436::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-830::DEBUG::2013-12-12 13:56:43,444::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-830::DEBUG::2013-12-12 13:56:43,610::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-833::DEBUG::2013-12-12 13:56:50,672::task::579::TaskManager.Task::(_updateState) Task=`3ac95221-aa19-435a-abba-e5c369f7efb3`::moving from state init -> state preparing >Thread-833::INFO::2013-12-12 13:56:50,672::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-833::INFO::2013-12-12 13:56:50,673::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-833::DEBUG::2013-12-12 13:56:50,673::task::1168::TaskManager.Task::(prepare) Task=`3ac95221-aa19-435a-abba-e5c369f7efb3`::finished: {} >Thread-833::DEBUG::2013-12-12 13:56:50,673::task::579::TaskManager.Task::(_updateState) Task=`3ac95221-aa19-435a-abba-e5c369f7efb3`::moving from state preparing -> state finished >Thread-833::DEBUG::2013-12-12 13:56:50,673::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-833::DEBUG::2013-12-12 13:56:50,673::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-833::DEBUG::2013-12-12 13:56:50,673::task::974::TaskManager.Task::(_decref) Task=`3ac95221-aa19-435a-abba-e5c369f7efb3`::ref 0 aborting False >Thread-836::DEBUG::2013-12-12 13:56:54,161::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-836::DEBUG::2013-12-12 13:56:54,486::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-837::DEBUG::2013-12-12 13:56:54,496::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-837::DEBUG::2013-12-12 13:56:54,661::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-841::DEBUG::2013-12-12 13:57:05,848::task::579::TaskManager.Task::(_updateState) Task=`3f64720c-a12f-4d69-87be-8867daeb268b`::moving from state init -> state preparing >Thread-841::INFO::2013-12-12 13:57:05,848::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-841::INFO::2013-12-12 13:57:05,849::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-841::DEBUG::2013-12-12 13:57:05,849::task::1168::TaskManager.Task::(prepare) Task=`3f64720c-a12f-4d69-87be-8867daeb268b`::finished: {} >Thread-841::DEBUG::2013-12-12 13:57:05,849::task::579::TaskManager.Task::(_updateState) Task=`3f64720c-a12f-4d69-87be-8867daeb268b`::moving from state preparing -> state finished >Thread-841::DEBUG::2013-12-12 13:57:05,850::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-841::DEBUG::2013-12-12 13:57:05,850::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-841::DEBUG::2013-12-12 13:57:05,850::task::974::TaskManager.Task::(_decref) Task=`3f64720c-a12f-4d69-87be-8867daeb268b`::ref 0 aborting False >Thread-844::DEBUG::2013-12-12 13:57:10,737::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-844::DEBUG::2013-12-12 13:57:11,069::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-845::DEBUG::2013-12-12 13:57:11,076::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-845::DEBUG::2013-12-12 13:57:11,244::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-849::DEBUG::2013-12-12 13:57:20,937::task::579::TaskManager.Task::(_updateState) Task=`8985b84e-3310-465f-8249-9a4e9d9d8a89`::moving from state init -> state preparing >Thread-849::INFO::2013-12-12 13:57:20,937::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-849::INFO::2013-12-12 13:57:20,937::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-849::DEBUG::2013-12-12 13:57:20,937::task::1168::TaskManager.Task::(prepare) Task=`8985b84e-3310-465f-8249-9a4e9d9d8a89`::finished: {} >Thread-849::DEBUG::2013-12-12 13:57:20,938::task::579::TaskManager.Task::(_updateState) Task=`8985b84e-3310-465f-8249-9a4e9d9d8a89`::moving from state preparing -> state finished >Thread-849::DEBUG::2013-12-12 13:57:20,938::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-849::DEBUG::2013-12-12 13:57:20,938::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-849::DEBUG::2013-12-12 13:57:20,938::task::974::TaskManager.Task::(_decref) Task=`8985b84e-3310-465f-8249-9a4e9d9d8a89`::ref 0 aborting False >Thread-851::DEBUG::2013-12-12 13:57:21,794::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-851::DEBUG::2013-12-12 13:57:22,125::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-852::DEBUG::2013-12-12 13:57:22,132::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-852::DEBUG::2013-12-12 13:57:22,300::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-857::DEBUG::2013-12-12 13:57:36,022::task::579::TaskManager.Task::(_updateState) Task=`fdf416de-d34f-4422-aec5-3ecfdc93f1b1`::moving from state init -> state preparing >Thread-857::INFO::2013-12-12 13:57:36,022::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-857::INFO::2013-12-12 13:57:36,022::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-857::DEBUG::2013-12-12 13:57:36,022::task::1168::TaskManager.Task::(prepare) Task=`fdf416de-d34f-4422-aec5-3ecfdc93f1b1`::finished: {} >Thread-857::DEBUG::2013-12-12 13:57:36,022::task::579::TaskManager.Task::(_updateState) Task=`fdf416de-d34f-4422-aec5-3ecfdc93f1b1`::moving from state preparing -> state finished >Thread-857::DEBUG::2013-12-12 13:57:36,023::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-857::DEBUG::2013-12-12 13:57:36,023::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-857::DEBUG::2013-12-12 13:57:36,023::task::974::TaskManager.Task::(_decref) Task=`fdf416de-d34f-4422-aec5-3ecfdc93f1b1`::ref 0 aborting False >Thread-859::DEBUG::2013-12-12 13:57:38,413::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-859::DEBUG::2013-12-12 13:57:38,741::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-860::DEBUG::2013-12-12 13:57:38,749::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-860::DEBUG::2013-12-12 13:57:38,916::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-863::DEBUG::2013-12-12 13:57:43,936::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-863::DEBUG::2013-12-12 13:57:44,267::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-864::DEBUG::2013-12-12 13:57:44,276::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-864::DEBUG::2013-12-12 13:57:44,447::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-867::DEBUG::2013-12-12 13:57:51,109::task::579::TaskManager.Task::(_updateState) Task=`4d60d1ab-e042-4b61-970f-22cbab8f0594`::moving from state init -> state preparing >Thread-867::INFO::2013-12-12 13:57:51,110::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-867::INFO::2013-12-12 13:57:51,110::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-867::DEBUG::2013-12-12 13:57:51,110::task::1168::TaskManager.Task::(prepare) Task=`4d60d1ab-e042-4b61-970f-22cbab8f0594`::finished: {} >Thread-867::DEBUG::2013-12-12 13:57:51,110::task::579::TaskManager.Task::(_updateState) Task=`4d60d1ab-e042-4b61-970f-22cbab8f0594`::moving from state preparing -> state finished >Thread-867::DEBUG::2013-12-12 13:57:51,110::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-867::DEBUG::2013-12-12 13:57:51,111::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-867::DEBUG::2013-12-12 13:57:51,111::task::974::TaskManager.Task::(_decref) Task=`4d60d1ab-e042-4b61-970f-22cbab8f0594`::ref 0 aborting False >Thread-870::DEBUG::2013-12-12 13:57:54,993::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-870::DEBUG::2013-12-12 13:57:55,323::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-871::DEBUG::2013-12-12 13:57:55,331::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-871::DEBUG::2013-12-12 13:57:55,497::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-875::DEBUG::2013-12-12 13:58:03,533::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-875::DEBUG::2013-12-12 13:58:03,707::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-876::DEBUG::2013-12-12 13:58:06,050::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-877::DEBUG::2013-12-12 13:58:06,208::task::579::TaskManager.Task::(_updateState) Task=`9647f4da-fcbf-40f3-9e46-ecd971a203e8`::moving from state init -> state preparing >Thread-877::INFO::2013-12-12 13:58:06,208::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-877::INFO::2013-12-12 13:58:06,209::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-877::DEBUG::2013-12-12 13:58:06,209::task::1168::TaskManager.Task::(prepare) Task=`9647f4da-fcbf-40f3-9e46-ecd971a203e8`::finished: {} >Thread-877::DEBUG::2013-12-12 13:58:06,209::task::579::TaskManager.Task::(_updateState) Task=`9647f4da-fcbf-40f3-9e46-ecd971a203e8`::moving from state preparing -> state finished >Thread-877::DEBUG::2013-12-12 13:58:06,209::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-877::DEBUG::2013-12-12 13:58:06,209::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-877::DEBUG::2013-12-12 13:58:06,209::task::974::TaskManager.Task::(_decref) Task=`9647f4da-fcbf-40f3-9e46-ecd971a203e8`::ref 0 aborting False >Thread-876::DEBUG::2013-12-12 13:58:06,387::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-879::DEBUG::2013-12-12 13:58:06,399::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-879::DEBUG::2013-12-12 13:58:06,564::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-881::DEBUG::2013-12-12 13:58:11,588::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} flowID [44ea9dad] >Thread-881::DEBUG::2013-12-12 13:58:11,915::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-882::DEBUG::2013-12-12 13:58:11,922::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} flowID [44ea9dad] >Thread-882::DEBUG::2013-12-12 13:58:12,086::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-886::DEBUG::2013-12-12 13:58:21,356::task::579::TaskManager.Task::(_updateState) Task=`3396f322-d3ab-4f8c-aa84-7055360a0362`::moving from state init -> state preparing >Thread-886::INFO::2013-12-12 13:58:21,357::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-886::INFO::2013-12-12 13:58:21,357::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-886::DEBUG::2013-12-12 13:58:21,357::task::1168::TaskManager.Task::(prepare) Task=`3396f322-d3ab-4f8c-aa84-7055360a0362`::finished: {} >Thread-886::DEBUG::2013-12-12 13:58:21,357::task::579::TaskManager.Task::(_updateState) Task=`3396f322-d3ab-4f8c-aa84-7055360a0362`::moving from state preparing -> state finished >Thread-886::DEBUG::2013-12-12 13:58:21,357::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-886::DEBUG::2013-12-12 13:58:21,358::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-886::DEBUG::2013-12-12 13:58:21,358::task::974::TaskManager.Task::(_decref) Task=`3396f322-d3ab-4f8c-aa84-7055360a0362`::ref 0 aborting False >Thread-890::DEBUG::2013-12-12 13:58:28,197::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-890::DEBUG::2013-12-12 13:58:28,526::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-891::DEBUG::2013-12-12 13:58:28,533::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-891::DEBUG::2013-12-12 13:58:28,699::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-894::DEBUG::2013-12-12 13:58:33,719::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-894::DEBUG::2013-12-12 13:58:34,049::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-895::DEBUG::2013-12-12 13:58:34,059::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-895::DEBUG::2013-12-12 13:58:34,224::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-896::DEBUG::2013-12-12 13:58:36,450::task::579::TaskManager.Task::(_updateState) Task=`7782448c-27c6-4a07-930d-33de916aa803`::moving from state init -> state preparing >Thread-896::INFO::2013-12-12 13:58:36,450::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-896::INFO::2013-12-12 13:58:36,450::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-896::DEBUG::2013-12-12 13:58:36,451::task::1168::TaskManager.Task::(prepare) Task=`7782448c-27c6-4a07-930d-33de916aa803`::finished: {} >Thread-896::DEBUG::2013-12-12 13:58:36,451::task::579::TaskManager.Task::(_updateState) Task=`7782448c-27c6-4a07-930d-33de916aa803`::moving from state preparing -> state finished >Thread-896::DEBUG::2013-12-12 13:58:36,451::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-896::DEBUG::2013-12-12 13:58:36,451::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-896::DEBUG::2013-12-12 13:58:36,451::task::974::TaskManager.Task::(_decref) Task=`7782448c-27c6-4a07-930d-33de916aa803`::ref 0 aborting False >Thread-898::DEBUG::2013-12-12 13:58:39,246::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-898::DEBUG::2013-12-12 13:58:39,580::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-900::DEBUG::2013-12-12 13:58:39,587::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-900::DEBUG::2013-12-12 13:58:39,754::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-902::DEBUG::2013-12-12 13:58:44,774::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-902::DEBUG::2013-12-12 13:58:45,106::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-903::DEBUG::2013-12-12 13:58:45,116::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-903::DEBUG::2013-12-12 13:58:45,282::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-906::DEBUG::2013-12-12 13:58:50,303::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-906::DEBUG::2013-12-12 13:58:50,628::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-907::DEBUG::2013-12-12 13:58:50,639::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-907::DEBUG::2013-12-12 13:58:50,804::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-908::DEBUG::2013-12-12 13:58:51,545::task::579::TaskManager.Task::(_updateState) Task=`d8238da9-b949-4b5e-9a06-d7afe87a2349`::moving from state init -> state preparing >Thread-908::INFO::2013-12-12 13:58:51,545::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-908::INFO::2013-12-12 13:58:51,546::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-908::DEBUG::2013-12-12 13:58:51,546::task::1168::TaskManager.Task::(prepare) Task=`d8238da9-b949-4b5e-9a06-d7afe87a2349`::finished: {} >Thread-908::DEBUG::2013-12-12 13:58:51,546::task::579::TaskManager.Task::(_updateState) Task=`d8238da9-b949-4b5e-9a06-d7afe87a2349`::moving from state preparing -> state finished >Thread-908::DEBUG::2013-12-12 13:58:51,546::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-908::DEBUG::2013-12-12 13:58:51,546::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-908::DEBUG::2013-12-12 13:58:51,546::task::974::TaskManager.Task::(_decref) Task=`d8238da9-b949-4b5e-9a06-d7afe87a2349`::ref 0 aborting False >Thread-911::DEBUG::2013-12-12 13:58:55,828::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-911::DEBUG::2013-12-12 13:58:56,165::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-912::DEBUG::2013-12-12 13:58:56,173::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-912::DEBUG::2013-12-12 13:58:56,342::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-916::DEBUG::2013-12-12 13:59:06,650::task::579::TaskManager.Task::(_updateState) Task=`094806cb-319e-481b-8f3e-d16a5a51715b`::moving from state init -> state preparing >Thread-916::INFO::2013-12-12 13:59:06,650::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-916::INFO::2013-12-12 13:59:06,650::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-916::DEBUG::2013-12-12 13:59:06,650::task::1168::TaskManager.Task::(prepare) Task=`094806cb-319e-481b-8f3e-d16a5a51715b`::finished: {} >Thread-916::DEBUG::2013-12-12 13:59:06,651::task::579::TaskManager.Task::(_updateState) Task=`094806cb-319e-481b-8f3e-d16a5a51715b`::moving from state preparing -> state finished >Thread-916::DEBUG::2013-12-12 13:59:06,651::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-916::DEBUG::2013-12-12 13:59:06,651::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-916::DEBUG::2013-12-12 13:59:06,651::task::974::TaskManager.Task::(_decref) Task=`094806cb-319e-481b-8f3e-d16a5a51715b`::ref 0 aborting False >Thread-918::DEBUG::2013-12-12 13:59:06,910::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-918::DEBUG::2013-12-12 13:59:07,239::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-919::DEBUG::2013-12-12 13:59:07,249::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-919::DEBUG::2013-12-12 13:59:07,417::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-921::DEBUG::2013-12-12 13:59:12,441::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-921::DEBUG::2013-12-12 13:59:12,780::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-923::DEBUG::2013-12-12 13:59:12,787::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-923::DEBUG::2013-12-12 13:59:12,956::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-926::DEBUG::2013-12-12 13:59:21,784::task::579::TaskManager.Task::(_updateState) Task=`64bdb286-efa4-47ab-b257-131711f668d4`::moving from state init -> state preparing >Thread-926::INFO::2013-12-12 13:59:21,784::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-926::INFO::2013-12-12 13:59:21,785::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-926::DEBUG::2013-12-12 13:59:21,785::task::1168::TaskManager.Task::(prepare) Task=`64bdb286-efa4-47ab-b257-131711f668d4`::finished: {} >Thread-926::DEBUG::2013-12-12 13:59:21,785::task::579::TaskManager.Task::(_updateState) Task=`64bdb286-efa4-47ab-b257-131711f668d4`::moving from state preparing -> state finished >Thread-926::DEBUG::2013-12-12 13:59:21,785::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-926::DEBUG::2013-12-12 13:59:21,785::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-926::DEBUG::2013-12-12 13:59:21,785::task::974::TaskManager.Task::(_decref) Task=`64bdb286-efa4-47ab-b257-131711f668d4`::ref 0 aborting False >Thread-928::DEBUG::2013-12-12 13:59:23,512::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-928::DEBUG::2013-12-12 13:59:23,841::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-929::DEBUG::2013-12-12 13:59:23,848::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-929::DEBUG::2013-12-12 13:59:24,018::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-934::DEBUG::2013-12-12 13:59:36,906::task::579::TaskManager.Task::(_updateState) Task=`d8ec5331-ec03-48cd-8959-df1eed362f00`::moving from state init -> state preparing >Thread-934::INFO::2013-12-12 13:59:36,906::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-934::INFO::2013-12-12 13:59:36,907::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-934::DEBUG::2013-12-12 13:59:36,907::task::1168::TaskManager.Task::(prepare) Task=`d8ec5331-ec03-48cd-8959-df1eed362f00`::finished: {} >Thread-934::DEBUG::2013-12-12 13:59:36,907::task::579::TaskManager.Task::(_updateState) Task=`d8ec5331-ec03-48cd-8959-df1eed362f00`::moving from state preparing -> state finished >Thread-934::DEBUG::2013-12-12 13:59:36,907::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-934::DEBUG::2013-12-12 13:59:36,907::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-934::DEBUG::2013-12-12 13:59:36,908::task::974::TaskManager.Task::(_decref) Task=`d8ec5331-ec03-48cd-8959-df1eed362f00`::ref 0 aborting False >Thread-940::DEBUG::2013-12-12 13:59:52,031::task::579::TaskManager.Task::(_updateState) Task=`8120aa02-df65-48d3-a89c-2d136c1c4835`::moving from state init -> state preparing >Thread-940::INFO::2013-12-12 13:59:52,031::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-940::INFO::2013-12-12 13:59:52,031::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-940::DEBUG::2013-12-12 13:59:52,031::task::1168::TaskManager.Task::(prepare) Task=`8120aa02-df65-48d3-a89c-2d136c1c4835`::finished: {} >Thread-940::DEBUG::2013-12-12 13:59:52,031::task::579::TaskManager.Task::(_updateState) Task=`8120aa02-df65-48d3-a89c-2d136c1c4835`::moving from state preparing -> state finished >Thread-940::DEBUG::2013-12-12 13:59:52,032::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-940::DEBUG::2013-12-12 13:59:52,032::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-940::DEBUG::2013-12-12 13:59:52,032::task::974::TaskManager.Task::(_decref) Task=`8120aa02-df65-48d3-a89c-2d136c1c4835`::ref 0 aborting False >Thread-943::DEBUG::2013-12-12 13:59:56,669::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-943::DEBUG::2013-12-12 13:59:56,996::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-944::DEBUG::2013-12-12 13:59:57,005::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-944::DEBUG::2013-12-12 13:59:57,171::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-948::DEBUG::2013-12-12 14:00:07,202::task::579::TaskManager.Task::(_updateState) Task=`d7ba7a27-cde2-4679-baff-aac31cc1e660`::moving from state init -> state preparing >Thread-948::INFO::2013-12-12 14:00:07,202::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-948::INFO::2013-12-12 14:00:07,202::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-948::DEBUG::2013-12-12 14:00:07,203::task::1168::TaskManager.Task::(prepare) Task=`d7ba7a27-cde2-4679-baff-aac31cc1e660`::finished: {} >Thread-948::DEBUG::2013-12-12 14:00:07,203::task::579::TaskManager.Task::(_updateState) Task=`d7ba7a27-cde2-4679-baff-aac31cc1e660`::moving from state preparing -> state finished >Thread-948::DEBUG::2013-12-12 14:00:07,203::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-948::DEBUG::2013-12-12 14:00:07,203::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-948::DEBUG::2013-12-12 14:00:07,203::task::974::TaskManager.Task::(_decref) Task=`d7ba7a27-cde2-4679-baff-aac31cc1e660`::ref 0 aborting False >Thread-950::DEBUG::2013-12-12 14:00:07,713::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-950::DEBUG::2013-12-12 14:00:08,041::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-951::DEBUG::2013-12-12 14:00:08,048::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-951::DEBUG::2013-12-12 14:00:08,213::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-953::DEBUG::2013-12-12 14:00:13,233::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-953::DEBUG::2013-12-12 14:00:13,563::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-955::DEBUG::2013-12-12 14:00:13,570::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-955::DEBUG::2013-12-12 14:00:13,736::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-957::DEBUG::2013-12-12 14:00:18,757::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-957::DEBUG::2013-12-12 14:00:19,086::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-958::DEBUG::2013-12-12 14:00:19,094::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-958::DEBUG::2013-12-12 14:00:19,261::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-960::DEBUG::2013-12-12 14:00:22,410::task::579::TaskManager.Task::(_updateState) Task=`ba215035-5ee4-49a6-9b4c-e89e3d446d79`::moving from state init -> state preparing >Thread-960::INFO::2013-12-12 14:00:22,411::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-960::INFO::2013-12-12 14:00:22,411::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-960::DEBUG::2013-12-12 14:00:22,411::task::1168::TaskManager.Task::(prepare) Task=`ba215035-5ee4-49a6-9b4c-e89e3d446d79`::finished: {} >Thread-960::DEBUG::2013-12-12 14:00:22,412::task::579::TaskManager.Task::(_updateState) Task=`ba215035-5ee4-49a6-9b4c-e89e3d446d79`::moving from state preparing -> state finished >Thread-960::DEBUG::2013-12-12 14:00:22,412::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-960::DEBUG::2013-12-12 14:00:22,412::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-960::DEBUG::2013-12-12 14:00:22,413::task::974::TaskManager.Task::(_decref) Task=`ba215035-5ee4-49a6-9b4c-e89e3d446d79`::ref 0 aborting False >Thread-962::DEBUG::2013-12-12 14:00:24,284::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-962::DEBUG::2013-12-12 14:00:24,613::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-963::DEBUG::2013-12-12 14:00:24,620::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-963::DEBUG::2013-12-12 14:00:24,787::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-966::DEBUG::2013-12-12 14:00:29,807::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-966::DEBUG::2013-12-12 14:00:30,136::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-967::DEBUG::2013-12-12 14:00:30,143::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-967::DEBUG::2013-12-12 14:00:30,310::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-970::DEBUG::2013-12-12 14:00:37,546::task::579::TaskManager.Task::(_updateState) Task=`8b35d7c0-ab51-42b4-9d6a-ed55e8e66a22`::moving from state init -> state preparing >Thread-970::INFO::2013-12-12 14:00:37,546::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-970::INFO::2013-12-12 14:00:37,547::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-970::DEBUG::2013-12-12 14:00:37,547::task::1168::TaskManager.Task::(prepare) Task=`8b35d7c0-ab51-42b4-9d6a-ed55e8e66a22`::finished: {} >Thread-970::DEBUG::2013-12-12 14:00:37,547::task::579::TaskManager.Task::(_updateState) Task=`8b35d7c0-ab51-42b4-9d6a-ed55e8e66a22`::moving from state preparing -> state finished >Thread-970::DEBUG::2013-12-12 14:00:37,547::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-970::DEBUG::2013-12-12 14:00:37,547::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-970::DEBUG::2013-12-12 14:00:37,547::task::974::TaskManager.Task::(_decref) Task=`8b35d7c0-ab51-42b4-9d6a-ed55e8e66a22`::ref 0 aborting False >Thread-973::DEBUG::2013-12-12 14:00:40,851::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-973::DEBUG::2013-12-12 14:00:41,176::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-974::DEBUG::2013-12-12 14:00:41,183::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-974::DEBUG::2013-12-12 14:00:41,350::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-976::DEBUG::2013-12-12 14:00:46,375::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-976::DEBUG::2013-12-12 14:00:46,710::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-978::DEBUG::2013-12-12 14:00:46,717::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-978::DEBUG::2013-12-12 14:00:46,882::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-980::DEBUG::2013-12-12 14:00:51,902::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-980::DEBUG::2013-12-12 14:00:52,234::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-981::DEBUG::2013-12-12 14:00:52,241::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-981::DEBUG::2013-12-12 14:00:52,410::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-982::DEBUG::2013-12-12 14:00:52,673::task::579::TaskManager.Task::(_updateState) Task=`a5c8c794-7071-43d2-aee9-7e581be5e8d7`::moving from state init -> state preparing >Thread-982::INFO::2013-12-12 14:00:52,673::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-982::INFO::2013-12-12 14:00:52,673::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-982::DEBUG::2013-12-12 14:00:52,673::task::1168::TaskManager.Task::(prepare) Task=`a5c8c794-7071-43d2-aee9-7e581be5e8d7`::finished: {} >Thread-982::DEBUG::2013-12-12 14:00:52,674::task::579::TaskManager.Task::(_updateState) Task=`a5c8c794-7071-43d2-aee9-7e581be5e8d7`::moving from state preparing -> state finished >Thread-982::DEBUG::2013-12-12 14:00:52,674::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-982::DEBUG::2013-12-12 14:00:52,674::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-982::DEBUG::2013-12-12 14:00:52,674::task::974::TaskManager.Task::(_decref) Task=`a5c8c794-7071-43d2-aee9-7e581be5e8d7`::ref 0 aborting False >Thread-986::DEBUG::2013-12-12 14:00:59,817::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumeStatus with ('StartMigrationDuringRebalanceTest', '', '') {} >Thread-986::DEBUG::2013-12-12 14:00:59,994::BindingXMLRPC::991::vds::(wrapper) return volumeStatus with {'volumeStatus': {'bricks': [{'status': 'ONLINE', 'brick': 'latest-a:/bricks/201312121333559771942637805', 'pid': '6101', 'port': '49152', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}, {'status': 'ONLINE', 'brick': 'latest-a:/bricks/20131212133357392850249563', 'pid': '6113', 'port': '49153', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}, {'status': 'ONLINE', 'brick': 'latest-a:/bricks/201312121333573941245056192', 'pid': '6124', 'port': '49154', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/20131212133357394550199115', 'pid': '5872', 'port': '49152', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/20131212133357395516730110', 'pid': '5883', 'port': '49153', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/201312121333573951287551485', 'pid': '5894', 'port': '49154', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/20131212133418659927299489', 'pid': '5905', 'port': '49155', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'brick': 'latest-a:/bricks/20131212133427138341374234', 'pid': '6136', 'port': '49155', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}, {'status': 'ONLINE', 'brick': 'latest-b:/bricks/20131212133434230219930446', 'pid': '5916', 'port': '49156', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'brick': 'latest-a:/bricks/201312121334434851151947411', 'pid': '6147', 'port': '49156', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}], 'nfs': [{'status': 'ONLINE', 'hostname': '10.14.16.127', 'pid': '5930', 'port': '2049', 'hostuuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'ONLINE', 'hostname': '10.14.16.132', 'pid': '6159', 'port': '2049', 'hostuuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}], 'shd': [], 'name': 'StartMigrationDuringRebalanceTest'}, 'status': {'message': 'Done', 'code': 0}} >Thread-988::DEBUG::2013-12-12 14:01:02,951::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-988::DEBUG::2013-12-12 14:01:03,473::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-989::DEBUG::2013-12-12 14:01:03,481::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-989::DEBUG::2013-12-12 14:01:03,744::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-991::DEBUG::2013-12-12 14:01:07,783::task::579::TaskManager.Task::(_updateState) Task=`24379999-be06-4741-a99d-56e05b6d9be0`::moving from state init -> state preparing >Thread-991::INFO::2013-12-12 14:01:07,783::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-991::INFO::2013-12-12 14:01:07,784::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-991::DEBUG::2013-12-12 14:01:07,784::task::1168::TaskManager.Task::(prepare) Task=`24379999-be06-4741-a99d-56e05b6d9be0`::finished: {} >Thread-991::DEBUG::2013-12-12 14:01:07,784::task::579::TaskManager.Task::(_updateState) Task=`24379999-be06-4741-a99d-56e05b6d9be0`::moving from state preparing -> state finished >Thread-991::DEBUG::2013-12-12 14:01:07,784::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-991::DEBUG::2013-12-12 14:01:07,784::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-991::DEBUG::2013-12-12 14:01:07,784::task::974::TaskManager.Task::(_decref) Task=`24379999-be06-4741-a99d-56e05b6d9be0`::ref 0 aborting False >Thread-993::DEBUG::2013-12-12 14:01:08,765::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-993::DEBUG::2013-12-12 14:01:09,234::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-994::DEBUG::2013-12-12 14:01:09,242::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-994::DEBUG::2013-12-12 14:01:09,484::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-999::DEBUG::2013-12-12 14:01:20,242::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-999::DEBUG::2013-12-12 14:01:20,715::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-1000::DEBUG::2013-12-12 14:01:20,723::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-1000::DEBUG::2013-12-12 14:01:20,966::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-1001::DEBUG::2013-12-12 14:01:22,943::task::579::TaskManager.Task::(_updateState) Task=`f3d645c1-b41a-40fb-a52e-1eb4a406f0bc`::moving from state init -> state preparing >Thread-1001::INFO::2013-12-12 14:01:22,943::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1001::INFO::2013-12-12 14:01:22,943::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1001::DEBUG::2013-12-12 14:01:22,944::task::1168::TaskManager.Task::(prepare) Task=`f3d645c1-b41a-40fb-a52e-1eb4a406f0bc`::finished: {} >Thread-1001::DEBUG::2013-12-12 14:01:22,944::task::579::TaskManager.Task::(_updateState) Task=`f3d645c1-b41a-40fb-a52e-1eb4a406f0bc`::moving from state preparing -> state finished >Thread-1001::DEBUG::2013-12-12 14:01:22,944::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1001::DEBUG::2013-12-12 14:01:22,944::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1001::DEBUG::2013-12-12 14:01:22,944::task::974::TaskManager.Task::(_decref) Task=`f3d645c1-b41a-40fb-a52e-1eb4a406f0bc`::ref 0 aborting False >Thread-1007::DEBUG::2013-12-12 14:01:37,034::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-1007::DEBUG::2013-12-12 14:01:37,364::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-1008::DEBUG::2013-12-12 14:01:37,372::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-1008::DEBUG::2013-12-12 14:01:37,542::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-1009::DEBUG::2013-12-12 14:01:38,310::task::579::TaskManager.Task::(_updateState) Task=`f7b01381-e856-47f2-9720-ea50a2fa0017`::moving from state init -> state preparing >Thread-1009::INFO::2013-12-12 14:01:38,310::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1009::INFO::2013-12-12 14:01:38,310::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1009::DEBUG::2013-12-12 14:01:38,310::task::1168::TaskManager.Task::(prepare) Task=`f7b01381-e856-47f2-9720-ea50a2fa0017`::finished: {} >Thread-1009::DEBUG::2013-12-12 14:01:38,311::task::579::TaskManager.Task::(_updateState) Task=`f7b01381-e856-47f2-9720-ea50a2fa0017`::moving from state preparing -> state finished >Thread-1009::DEBUG::2013-12-12 14:01:38,311::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1009::DEBUG::2013-12-12 14:01:38,311::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1009::DEBUG::2013-12-12 14:01:38,311::task::974::TaskManager.Task::(_decref) Task=`f7b01381-e856-47f2-9720-ea50a2fa0017`::ref 0 aborting False >Thread-1012::DEBUG::2013-12-12 14:01:42,563::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-1012::DEBUG::2013-12-12 14:01:42,890::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-1013::DEBUG::2013-12-12 14:01:42,898::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-1013::DEBUG::2013-12-12 14:01:43,067::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-1017::DEBUG::2013-12-12 14:01:53,425::task::579::TaskManager.Task::(_updateState) Task=`8867e4cb-aa6f-456c-800c-4d13ec828551`::moving from state init -> state preparing >Thread-1017::INFO::2013-12-12 14:01:53,426::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1017::INFO::2013-12-12 14:01:53,426::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1017::DEBUG::2013-12-12 14:01:53,426::task::1168::TaskManager.Task::(prepare) Task=`8867e4cb-aa6f-456c-800c-4d13ec828551`::finished: {} >Thread-1017::DEBUG::2013-12-12 14:01:53,426::task::579::TaskManager.Task::(_updateState) Task=`8867e4cb-aa6f-456c-800c-4d13ec828551`::moving from state preparing -> state finished >Thread-1017::DEBUG::2013-12-12 14:01:53,426::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1017::DEBUG::2013-12-12 14:01:53,426::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1017::DEBUG::2013-12-12 14:01:53,427::task::974::TaskManager.Task::(_decref) Task=`8867e4cb-aa6f-456c-800c-4d13ec828551`::ref 0 aborting False >Thread-1020::DEBUG::2013-12-12 14:01:59,192::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-1020::DEBUG::2013-12-12 14:01:59,518::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-1021::DEBUG::2013-12-12 14:01:59,526::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-1021::DEBUG::2013-12-12 14:01:59,699::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-1024::DEBUG::2013-12-12 14:02:04,443::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call tasksList with () {} >Thread-1024::DEBUG::2013-12-12 14:02:04,615::BindingXMLRPC::991::vds::(wrapper) return tasksList with {'status': {'message': 'Done', 'code': 0}, 'tasks': {}} >Thread-1026::DEBUG::2013-12-12 14:02:08,718::task::579::TaskManager.Task::(_updateState) Task=`77559f2f-343e-462a-9e34-381869b237b3`::moving from state init -> state preparing >Thread-1026::INFO::2013-12-12 14:02:08,718::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1026::INFO::2013-12-12 14:02:08,718::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1026::DEBUG::2013-12-12 14:02:08,718::task::1168::TaskManager.Task::(prepare) Task=`77559f2f-343e-462a-9e34-381869b237b3`::finished: {} >Thread-1026::DEBUG::2013-12-12 14:02:08,719::task::579::TaskManager.Task::(_updateState) Task=`77559f2f-343e-462a-9e34-381869b237b3`::moving from state preparing -> state finished >Thread-1026::DEBUG::2013-12-12 14:02:08,719::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1026::DEBUG::2013-12-12 14:02:08,719::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1026::DEBUG::2013-12-12 14:02:08,719::task::974::TaskManager.Task::(_decref) Task=`77559f2f-343e-462a-9e34-381869b237b3`::ref 0 aborting False >Thread-1030::DEBUG::2013-12-12 14:02:15,784::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-1030::DEBUG::2013-12-12 14:02:16,110::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-1031::DEBUG::2013-12-12 14:02:16,117::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-1031::DEBUG::2013-12-12 14:02:16,286::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-1034::DEBUG::2013-12-12 14:02:21,306::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-1034::DEBUG::2013-12-12 14:02:21,636::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-1035::DEBUG::2013-12-12 14:02:21,644::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-1035::DEBUG::2013-12-12 14:02:21,809::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-1036::DEBUG::2013-12-12 14:02:23,924::task::579::TaskManager.Task::(_updateState) Task=`18069424-0c66-4069-b0c3-532d74826472`::moving from state init -> state preparing >Thread-1036::INFO::2013-12-12 14:02:23,925::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1036::INFO::2013-12-12 14:02:23,925::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1036::DEBUG::2013-12-12 14:02:23,925::task::1168::TaskManager.Task::(prepare) Task=`18069424-0c66-4069-b0c3-532d74826472`::finished: {} >Thread-1036::DEBUG::2013-12-12 14:02:23,925::task::579::TaskManager.Task::(_updateState) Task=`18069424-0c66-4069-b0c3-532d74826472`::moving from state preparing -> state finished >Thread-1036::DEBUG::2013-12-12 14:02:23,925::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1036::DEBUG::2013-12-12 14:02:23,926::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1036::DEBUG::2013-12-12 14:02:23,926::task::974::TaskManager.Task::(_decref) Task=`18069424-0c66-4069-b0c3-532d74826472`::ref 0 aborting False >Thread-1038::DEBUG::2013-12-12 14:02:26,829::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-1038::DEBUG::2013-12-12 14:02:27,168::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-1040::DEBUG::2013-12-12 14:02:27,175::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-1040::DEBUG::2013-12-12 14:02:27,342::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-1042::DEBUG::2013-12-12 14:02:32,363::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-1042::DEBUG::2013-12-12 14:02:32,692::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-1043::DEBUG::2013-12-12 14:02:32,700::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-1043::DEBUG::2013-12-12 14:02:32,874::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-1046::DEBUG::2013-12-12 14:02:39,057::task::579::TaskManager.Task::(_updateState) Task=`a801a676-6f16-4fa3-a086-453ea4368515`::moving from state init -> state preparing >Thread-1046::INFO::2013-12-12 14:02:39,058::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1046::INFO::2013-12-12 14:02:39,058::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1046::DEBUG::2013-12-12 14:02:39,058::task::1168::TaskManager.Task::(prepare) Task=`a801a676-6f16-4fa3-a086-453ea4368515`::finished: {} >Thread-1046::DEBUG::2013-12-12 14:02:39,058::task::579::TaskManager.Task::(_updateState) Task=`a801a676-6f16-4fa3-a086-453ea4368515`::moving from state preparing -> state finished >Thread-1046::DEBUG::2013-12-12 14:02:39,058::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1046::DEBUG::2013-12-12 14:02:39,058::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1046::DEBUG::2013-12-12 14:02:39,059::task::974::TaskManager.Task::(_decref) Task=`a801a676-6f16-4fa3-a086-453ea4368515`::ref 0 aborting False >Thread-1051::DEBUG::2013-12-12 14:02:48,960::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-1051::DEBUG::2013-12-12 14:02:49,294::BindingXMLRPC::991::vds::(wrapper) return hostsList with {'status': {'message': 'Done', 'code': 0}, 'hosts': [{'status': 'CONNECTED', 'hostname': '10.14.16.127', 'uuid': '553780c3-c742-4515-9861-4b90c5044dc4'}, {'status': 'CONNECTED', 'hostname': '10.14.16.132', 'uuid': 'bac2fdd4-c09f-466b-b977-bf240c911146'}]} >Thread-1052::DEBUG::2013-12-12 14:02:49,301::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} >Thread-1052::DEBUG::2013-12-12 14:02:49,469::BindingXMLRPC::991::vds::(wrapper) return volumesList with {'status': {'message': 'Done', 'code': 0}, 'volumes': {'StartMigrationDuringRebalanceTest': {'transportType': ['TCP'], 'uuid': '6504a995-e161-4543-8ae6-ccb36f29383e', 'bricks': ['latest-a:/bricks/201312121333559771942637805', 'latest-a:/bricks/20131212133357392850249563', 'latest-a:/bricks/201312121333573941245056192', 'latest-b:/bricks/20131212133357394550199115', 'latest-b:/bricks/20131212133357395516730110', 'latest-b:/bricks/201312121333573951287551485', 'latest-b:/bricks/20131212133418659927299489', 'latest-a:/bricks/20131212133427138341374234', 'latest-b:/bricks/20131212133434230219930446', 'latest-a:/bricks/201312121334434851151947411'], 'volumeName': 'StartMigrationDuringRebalanceTest', 'volumeType': 'DISTRIBUTE', 'replicaCount': '1', 'brickCount': '10', 'distCount': '1', 'volumeStatus': 'ONLINE', 'stripeCount': '1', 'options': {}}}} >Thread-1054::DEBUG::2013-12-12 14:02:54,193::task::579::TaskManager.Task::(_updateState) Task=`65b6c60c-eb28-468f-927a-51002686c814`::moving from state init -> state preparing >Thread-1054::INFO::2013-12-12 14:02:54,193::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1054::INFO::2013-12-12 14:02:54,194::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1054::DEBUG::2013-12-12 14:02:54,194::task::1168::TaskManager.Task::(prepare) Task=`65b6c60c-eb28-468f-927a-51002686c814`::finished: {} >Thread-1054::DEBUG::2013-12-12 14:02:54,194::task::579::TaskManager.Task::(_updateState) Task=`65b6c60c-eb28-468f-927a-51002686c814`::moving from state preparing -> state finished >Thread-1054::DEBUG::2013-12-12 14:02:54,194::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1054::DEBUG::2013-12-12 14:02:54,194::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1054::DEBUG::2013-12-12 14:02:54,194::task::974::TaskManager.Task::(_decref) Task=`65b6c60c-eb28-468f-927a-51002686c814`::ref 0 aborting False >Thread-1056::DEBUG::2013-12-12 14:02:54,505::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} >Thread-1056::ERROR::2013-12-12 14:02:56,429::BindingXMLRPC::1000::vds::(wrapper) vdsm exception occured >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 989, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 53, in wrapper > rv = func(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 229, in hostsList > return {'hosts': self.svdsmProxy.glusterPeerStatus()} > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in glusterPeerStatus > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >GlusterCmdExecFailedException: Command execution failed >error: Connection failed. Please check if gluster daemon is operational. >peer status: failed >return code: 1 >Thread-1058::DEBUG::2013-12-12 14:02:59,926::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call volumesList with () {} flowID [5b5b167c] >Thread-1058::ERROR::2013-12-12 14:03:02,935::BindingXMLRPC::1000::vds::(wrapper) vdsm exception occured >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 989, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 53, in wrapper > rv = func(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 77, in volumesList > return {'volumes': self.svdsmProxy.glusterVolumeInfo(volumeName)} > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in glusterVolumeInfo > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >GlusterCmdExecFailedException: Command execution failed >error: Connection failed. Please check if gluster daemon is operational. >return code: 1 >Thread-1062::DEBUG::2013-12-12 14:03:09,309::task::579::TaskManager.Task::(_updateState) Task=`debcdd6d-1b69-4f47-a73a-d06770265875`::moving from state init -> state preparing >Thread-1062::INFO::2013-12-12 14:03:09,309::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1062::INFO::2013-12-12 14:03:09,310::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1062::DEBUG::2013-12-12 14:03:09,310::task::1168::TaskManager.Task::(prepare) Task=`debcdd6d-1b69-4f47-a73a-d06770265875`::finished: {} >Thread-1062::DEBUG::2013-12-12 14:03:09,310::task::579::TaskManager.Task::(_updateState) Task=`debcdd6d-1b69-4f47-a73a-d06770265875`::moving from state preparing -> state finished >Thread-1062::DEBUG::2013-12-12 14:03:09,310::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1062::DEBUG::2013-12-12 14:03:09,310::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1062::DEBUG::2013-12-12 14:03:09,310::task::974::TaskManager.Task::(_decref) Task=`debcdd6d-1b69-4f47-a73a-d06770265875`::ref 0 aborting False >Thread-1068::DEBUG::2013-12-12 14:03:24,543::task::579::TaskManager.Task::(_updateState) Task=`3d81aeb0-3a17-452e-865d-70962fd9b4b1`::moving from state init -> state preparing >Thread-1068::INFO::2013-12-12 14:03:24,543::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1068::INFO::2013-12-12 14:03:24,544::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1068::DEBUG::2013-12-12 14:03:24,544::task::1168::TaskManager.Task::(prepare) Task=`3d81aeb0-3a17-452e-865d-70962fd9b4b1`::finished: {} >Thread-1068::DEBUG::2013-12-12 14:03:24,544::task::579::TaskManager.Task::(_updateState) Task=`3d81aeb0-3a17-452e-865d-70962fd9b4b1`::moving from state preparing -> state finished >Thread-1068::DEBUG::2013-12-12 14:03:24,545::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1068::DEBUG::2013-12-12 14:03:24,545::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1068::DEBUG::2013-12-12 14:03:24,545::task::974::TaskManager.Task::(_decref) Task=`3d81aeb0-3a17-452e-865d-70962fd9b4b1`::ref 0 aborting False >Thread-1074::DEBUG::2013-12-12 14:03:39,713::task::579::TaskManager.Task::(_updateState) Task=`538084ff-5414-4c97-8abc-048ed8945d8d`::moving from state init -> state preparing >Thread-1074::INFO::2013-12-12 14:03:39,713::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1074::INFO::2013-12-12 14:03:39,713::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1074::DEBUG::2013-12-12 14:03:39,714::task::1168::TaskManager.Task::(prepare) Task=`538084ff-5414-4c97-8abc-048ed8945d8d`::finished: {} >Thread-1074::DEBUG::2013-12-12 14:03:39,714::task::579::TaskManager.Task::(_updateState) Task=`538084ff-5414-4c97-8abc-048ed8945d8d`::moving from state preparing -> state finished >Thread-1074::DEBUG::2013-12-12 14:03:39,714::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1074::DEBUG::2013-12-12 14:03:39,714::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1074::DEBUG::2013-12-12 14:03:39,714::task::974::TaskManager.Task::(_decref) Task=`538084ff-5414-4c97-8abc-048ed8945d8d`::ref 0 aborting False >Thread-1080::DEBUG::2013-12-12 14:03:54,840::task::579::TaskManager.Task::(_updateState) Task=`1a80abd7-009a-48aa-af7b-8b04738df8f0`::moving from state init -> state preparing >Thread-1080::INFO::2013-12-12 14:03:54,841::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1080::INFO::2013-12-12 14:03:54,841::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1080::DEBUG::2013-12-12 14:03:54,841::task::1168::TaskManager.Task::(prepare) Task=`1a80abd7-009a-48aa-af7b-8b04738df8f0`::finished: {} >Thread-1080::DEBUG::2013-12-12 14:03:54,841::task::579::TaskManager.Task::(_updateState) Task=`1a80abd7-009a-48aa-af7b-8b04738df8f0`::moving from state preparing -> state finished >Thread-1080::DEBUG::2013-12-12 14:03:54,842::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1080::DEBUG::2013-12-12 14:03:54,842::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1080::DEBUG::2013-12-12 14:03:54,842::task::974::TaskManager.Task::(_decref) Task=`1a80abd7-009a-48aa-af7b-8b04738df8f0`::ref 0 aborting False >Thread-1086::DEBUG::2013-12-12 14:04:09,990::task::579::TaskManager.Task::(_updateState) Task=`7458ea56-c3b6-4115-882f-0e6f4f7fc659`::moving from state init -> state preparing >Thread-1086::INFO::2013-12-12 14:04:09,990::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1086::INFO::2013-12-12 14:04:09,990::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1086::DEBUG::2013-12-12 14:04:09,991::task::1168::TaskManager.Task::(prepare) Task=`7458ea56-c3b6-4115-882f-0e6f4f7fc659`::finished: {} >Thread-1086::DEBUG::2013-12-12 14:04:09,991::task::579::TaskManager.Task::(_updateState) Task=`7458ea56-c3b6-4115-882f-0e6f4f7fc659`::moving from state preparing -> state finished >Thread-1086::DEBUG::2013-12-12 14:04:09,991::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1086::DEBUG::2013-12-12 14:04:09,991::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1086::DEBUG::2013-12-12 14:04:09,992::task::974::TaskManager.Task::(_decref) Task=`7458ea56-c3b6-4115-882f-0e6f4f7fc659`::ref 0 aborting False >Thread-1092::DEBUG::2013-12-12 14:04:25,092::task::579::TaskManager.Task::(_updateState) Task=`09fa1d74-f958-4d85-8e36-b36f3cd23248`::moving from state init -> state preparing >Thread-1092::INFO::2013-12-12 14:04:25,093::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1092::INFO::2013-12-12 14:04:25,093::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1092::DEBUG::2013-12-12 14:04:25,093::task::1168::TaskManager.Task::(prepare) Task=`09fa1d74-f958-4d85-8e36-b36f3cd23248`::finished: {} >Thread-1092::DEBUG::2013-12-12 14:04:25,094::task::579::TaskManager.Task::(_updateState) Task=`09fa1d74-f958-4d85-8e36-b36f3cd23248`::moving from state preparing -> state finished >Thread-1092::DEBUG::2013-12-12 14:04:25,094::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1092::DEBUG::2013-12-12 14:04:25,094::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1092::DEBUG::2013-12-12 14:04:25,094::task::974::TaskManager.Task::(_decref) Task=`09fa1d74-f958-4d85-8e36-b36f3cd23248`::ref 0 aborting False >Thread-1098::DEBUG::2013-12-12 14:04:40,214::task::579::TaskManager.Task::(_updateState) Task=`3b11a060-a7f3-4944-adda-c933b86a7fea`::moving from state init -> state preparing >Thread-1098::INFO::2013-12-12 14:04:40,215::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1098::INFO::2013-12-12 14:04:40,215::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1098::DEBUG::2013-12-12 14:04:40,215::task::1168::TaskManager.Task::(prepare) Task=`3b11a060-a7f3-4944-adda-c933b86a7fea`::finished: {} >Thread-1098::DEBUG::2013-12-12 14:04:40,216::task::579::TaskManager.Task::(_updateState) Task=`3b11a060-a7f3-4944-adda-c933b86a7fea`::moving from state preparing -> state finished >Thread-1098::DEBUG::2013-12-12 14:04:40,216::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1098::DEBUG::2013-12-12 14:04:40,216::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1098::DEBUG::2013-12-12 14:04:40,216::task::974::TaskManager.Task::(_decref) Task=`3b11a060-a7f3-4944-adda-c933b86a7fea`::ref 0 aborting False >Thread-1104::DEBUG::2013-12-12 14:04:55,345::task::579::TaskManager.Task::(_updateState) Task=`62719d82-5f2b-4575-8cf8-49bb1e8608fd`::moving from state init -> state preparing >Thread-1104::INFO::2013-12-12 14:04:55,345::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1104::INFO::2013-12-12 14:04:55,346::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1104::DEBUG::2013-12-12 14:04:55,346::task::1168::TaskManager.Task::(prepare) Task=`62719d82-5f2b-4575-8cf8-49bb1e8608fd`::finished: {} >Thread-1104::DEBUG::2013-12-12 14:04:55,346::task::579::TaskManager.Task::(_updateState) Task=`62719d82-5f2b-4575-8cf8-49bb1e8608fd`::moving from state preparing -> state finished >Thread-1104::DEBUG::2013-12-12 14:04:55,346::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1104::DEBUG::2013-12-12 14:04:55,346::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1104::DEBUG::2013-12-12 14:04:55,346::task::974::TaskManager.Task::(_decref) Task=`62719d82-5f2b-4575-8cf8-49bb1e8608fd`::ref 0 aborting False >Thread-1108::DEBUG::2013-12-12 14:05:03,808::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getCapabilities with () {} flowID [7d343e0d] >Thread-1108::DEBUG::2013-12-12 14:05:03,808::utils::489::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-1108::DEBUG::2013-12-12 14:05:03,829::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1108::DEBUG::2013-12-12 14:05:03,841::caps::363::root::(_getKeyPackages) rpm package glusterfs-rdma not found >Thread-1108::DEBUG::2013-12-12 14:05:03,841::caps::363::root::(_getKeyPackages) rpm package glusterfs-fuse not found >Thread-1108::DEBUG::2013-12-12 14:05:03,842::caps::363::root::(_getKeyPackages) rpm package gluster-swift not found >Thread-1108::DEBUG::2013-12-12 14:05:03,843::caps::363::root::(_getKeyPackages) rpm package qemu-kvm-rhev not found >Thread-1108::DEBUG::2013-12-12 14:05:03,843::caps::363::root::(_getKeyPackages) rpm package gluster-swift-object not found >Thread-1108::DEBUG::2013-12-12 14:05:03,843::caps::363::root::(_getKeyPackages) rpm package glusterfs not found >Thread-1108::DEBUG::2013-12-12 14:05:03,843::caps::363::root::(_getKeyPackages) rpm package gluster-swift-plugin not found >Thread-1108::DEBUG::2013-12-12 14:05:03,845::caps::363::root::(_getKeyPackages) rpm package qemu-img-rhev not found >Thread-1108::DEBUG::2013-12-12 14:05:03,845::caps::363::root::(_getKeyPackages) rpm package ('mom',) not found >Thread-1108::DEBUG::2013-12-12 14:05:03,845::caps::363::root::(_getKeyPackages) rpm package gluster-swift-account not found >Thread-1108::DEBUG::2013-12-12 14:05:03,846::caps::363::root::(_getKeyPackages) rpm package gluster-swift-proxy not found >Thread-1108::DEBUG::2013-12-12 14:05:03,846::caps::363::root::(_getKeyPackages) rpm package gluster-swift-doc not found >Thread-1108::DEBUG::2013-12-12 14:05:03,846::caps::363::root::(_getKeyPackages) rpm package glusterfs-server not found >Thread-1108::DEBUG::2013-12-12 14:05:03,847::caps::363::root::(_getKeyPackages) rpm package gluster-swift-container not found >Thread-1108::DEBUG::2013-12-12 14:05:03,847::caps::363::root::(_getKeyPackages) rpm package glusterfs-geo-replication not found >Thread-1108::DEBUG::2013-12-12 14:05:03,848::BindingXMLRPC::991::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.28.1.el6.x86_64', 'buildtime': 1384533955.0, 'version': '2.6.32'}, 'vdsm': {'release': '23.1.el6rhs', 'buildtime': 1386773756L, 'version': '4.13.0'}, 'spice-server': {'release': '12.el6_4.5', 'buildtime': 1381834662L, 'version': '0.12.0'}, 'libvirt': {'release': '18.el6_4.13', 'buildtime': 1379320058L, 'version': '0.10.2'}}, 'cpuModel': 'QEMU Virtual CPU version 1.4.2', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.14.16.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.14.16.254', 'ports': ['eth0']}}, 'uuid': '7B904C94-94EE-7B49-40B3-BD3C28FBB749', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'netmask': '', 'addr': '', 'hwaddr': '52:54:00:b7:60:bc', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': '52:54:00:b7:60:bc', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 100, 'mtu': '1500'}}, 'software_revision': '23.1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': 'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,lm,up,rep_good,unfair_spinlock,pni,cx16,popcnt,hypervisor,lahf_lm', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '4062', 'cpuSpeed': '2393.998', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '1', 'kvmEnabled': 'false', 'rhsVersion': {'release': '1.el6rhs', 'version': '2.1.2.0', 'name': 'RHS'}, 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '1', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.14.16.112'}} >Thread-1109::DEBUG::2013-12-12 14:05:03,864::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getHardwareInfo with () {} flowID [7d343e0d] >Thread-1109::DEBUG::2013-12-12 14:05:03,866::BindingXMLRPC::991::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'Bochs', 'systemSerialNumber': 'Not Specified', 'systemFamily': 'Not Specified', 'systemVersion': 'Not Specified', 'systemUUID': '7b904c94-94ee-7b49-40b3-bd3c28fbb749', 'systemManufacturer': 'Bochs'}} >Thread-1110::DEBUG::2013-12-12 14:05:03,883::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} flowID [7d343e0d] >Thread-1110::ERROR::2013-12-12 14:05:06,892::BindingXMLRPC::1000::vds::(wrapper) vdsm exception occured >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 989, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 53, in wrapper > rv = func(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 229, in hostsList > return {'hosts': self.svdsmProxy.glusterPeerStatus()} > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in glusterPeerStatus > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >GlusterCmdExecFailedException: Command execution failed >error: Connection failed. Please check if gluster daemon is operational. >return code: 1 >Thread-1113::DEBUG::2013-12-12 14:05:13,454::task::579::TaskManager.Task::(_updateState) Task=`d2363a29-a8b9-47b6-a039-cf133d5b9235`::moving from state init -> state preparing >Thread-1113::INFO::2013-12-12 14:05:13,455::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1113::INFO::2013-12-12 14:05:13,455::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1113::DEBUG::2013-12-12 14:05:13,455::task::1168::TaskManager.Task::(prepare) Task=`d2363a29-a8b9-47b6-a039-cf133d5b9235`::finished: {} >Thread-1113::DEBUG::2013-12-12 14:05:13,455::task::579::TaskManager.Task::(_updateState) Task=`d2363a29-a8b9-47b6-a039-cf133d5b9235`::moving from state preparing -> state finished >Thread-1113::DEBUG::2013-12-12 14:05:13,455::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1113::DEBUG::2013-12-12 14:05:13,455::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1113::DEBUG::2013-12-12 14:05:13,456::task::974::TaskManager.Task::(_decref) Task=`d2363a29-a8b9-47b6-a039-cf133d5b9235`::ref 0 aborting False >Thread-1119::DEBUG::2013-12-12 14:05:28,583::task::579::TaskManager.Task::(_updateState) Task=`342daade-4783-4db4-8cbf-c306d00b9b97`::moving from state init -> state preparing >Thread-1119::INFO::2013-12-12 14:05:28,583::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1119::INFO::2013-12-12 14:05:28,584::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1119::DEBUG::2013-12-12 14:05:28,584::task::1168::TaskManager.Task::(prepare) Task=`342daade-4783-4db4-8cbf-c306d00b9b97`::finished: {} >Thread-1119::DEBUG::2013-12-12 14:05:28,584::task::579::TaskManager.Task::(_updateState) Task=`342daade-4783-4db4-8cbf-c306d00b9b97`::moving from state preparing -> state finished >Thread-1119::DEBUG::2013-12-12 14:05:28,584::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1119::DEBUG::2013-12-12 14:05:28,585::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1119::DEBUG::2013-12-12 14:05:28,585::task::974::TaskManager.Task::(_decref) Task=`342daade-4783-4db4-8cbf-c306d00b9b97`::ref 0 aborting False >Thread-1125::DEBUG::2013-12-12 14:05:43,690::task::579::TaskManager.Task::(_updateState) Task=`8bca3154-5917-4b90-b355-5c3fa8620cf8`::moving from state init -> state preparing >Thread-1125::INFO::2013-12-12 14:05:43,690::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1125::INFO::2013-12-12 14:05:43,690::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1125::DEBUG::2013-12-12 14:05:43,690::task::1168::TaskManager.Task::(prepare) Task=`8bca3154-5917-4b90-b355-5c3fa8620cf8`::finished: {} >Thread-1125::DEBUG::2013-12-12 14:05:43,691::task::579::TaskManager.Task::(_updateState) Task=`8bca3154-5917-4b90-b355-5c3fa8620cf8`::moving from state preparing -> state finished >Thread-1125::DEBUG::2013-12-12 14:05:43,691::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1125::DEBUG::2013-12-12 14:05:43,691::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1125::DEBUG::2013-12-12 14:05:43,691::task::974::TaskManager.Task::(_decref) Task=`8bca3154-5917-4b90-b355-5c3fa8620cf8`::ref 0 aborting False >Thread-1131::DEBUG::2013-12-12 14:05:58,809::task::579::TaskManager.Task::(_updateState) Task=`ced4925e-d38e-4c35-893a-960f822e7fb2`::moving from state init -> state preparing >Thread-1131::INFO::2013-12-12 14:05:58,809::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1131::INFO::2013-12-12 14:05:58,809::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1131::DEBUG::2013-12-12 14:05:58,809::task::1168::TaskManager.Task::(prepare) Task=`ced4925e-d38e-4c35-893a-960f822e7fb2`::finished: {} >Thread-1131::DEBUG::2013-12-12 14:05:58,810::task::579::TaskManager.Task::(_updateState) Task=`ced4925e-d38e-4c35-893a-960f822e7fb2`::moving from state preparing -> state finished >Thread-1131::DEBUG::2013-12-12 14:05:58,810::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1131::DEBUG::2013-12-12 14:05:58,810::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1131::DEBUG::2013-12-12 14:05:58,810::task::974::TaskManager.Task::(_decref) Task=`ced4925e-d38e-4c35-893a-960f822e7fb2`::ref 0 aborting False >Thread-1137::DEBUG::2013-12-12 14:06:13,928::task::579::TaskManager.Task::(_updateState) Task=`cc1211eb-9de0-4839-ac7e-1265c6f8de1b`::moving from state init -> state preparing >Thread-1137::INFO::2013-12-12 14:06:13,928::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1137::INFO::2013-12-12 14:06:13,929::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1137::DEBUG::2013-12-12 14:06:13,929::task::1168::TaskManager.Task::(prepare) Task=`cc1211eb-9de0-4839-ac7e-1265c6f8de1b`::finished: {} >Thread-1137::DEBUG::2013-12-12 14:06:13,929::task::579::TaskManager.Task::(_updateState) Task=`cc1211eb-9de0-4839-ac7e-1265c6f8de1b`::moving from state preparing -> state finished >Thread-1137::DEBUG::2013-12-12 14:06:13,929::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1137::DEBUG::2013-12-12 14:06:13,929::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1137::DEBUG::2013-12-12 14:06:13,929::task::974::TaskManager.Task::(_decref) Task=`cc1211eb-9de0-4839-ac7e-1265c6f8de1b`::ref 0 aborting False >Thread-1143::DEBUG::2013-12-12 14:06:29,060::task::579::TaskManager.Task::(_updateState) Task=`a06b7d40-1791-4386-ab7c-4f60ae7e26a3`::moving from state init -> state preparing >Thread-1143::INFO::2013-12-12 14:06:29,060::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1143::INFO::2013-12-12 14:06:29,060::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1143::DEBUG::2013-12-12 14:06:29,060::task::1168::TaskManager.Task::(prepare) Task=`a06b7d40-1791-4386-ab7c-4f60ae7e26a3`::finished: {} >Thread-1143::DEBUG::2013-12-12 14:06:29,060::task::579::TaskManager.Task::(_updateState) Task=`a06b7d40-1791-4386-ab7c-4f60ae7e26a3`::moving from state preparing -> state finished >Thread-1143::DEBUG::2013-12-12 14:06:29,061::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1143::DEBUG::2013-12-12 14:06:29,061::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1143::DEBUG::2013-12-12 14:06:29,061::task::974::TaskManager.Task::(_decref) Task=`a06b7d40-1791-4386-ab7c-4f60ae7e26a3`::ref 0 aborting False >Thread-1149::DEBUG::2013-12-12 14:06:44,185::task::579::TaskManager.Task::(_updateState) Task=`57334ed2-48ae-44c4-a5a2-3fef92eed44b`::moving from state init -> state preparing >Thread-1149::INFO::2013-12-12 14:06:44,186::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1149::INFO::2013-12-12 14:06:44,186::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1149::DEBUG::2013-12-12 14:06:44,186::task::1168::TaskManager.Task::(prepare) Task=`57334ed2-48ae-44c4-a5a2-3fef92eed44b`::finished: {} >Thread-1149::DEBUG::2013-12-12 14:06:44,186::task::579::TaskManager.Task::(_updateState) Task=`57334ed2-48ae-44c4-a5a2-3fef92eed44b`::moving from state preparing -> state finished >Thread-1149::DEBUG::2013-12-12 14:06:44,186::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1149::DEBUG::2013-12-12 14:06:44,187::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1149::DEBUG::2013-12-12 14:06:44,187::task::974::TaskManager.Task::(_decref) Task=`57334ed2-48ae-44c4-a5a2-3fef92eed44b`::ref 0 aborting False >Thread-1155::DEBUG::2013-12-12 14:06:59,307::task::579::TaskManager.Task::(_updateState) Task=`89db2adf-bb98-4a6a-8767-bc2ef82b4c34`::moving from state init -> state preparing >Thread-1155::INFO::2013-12-12 14:06:59,307::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1155::INFO::2013-12-12 14:06:59,307::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1155::DEBUG::2013-12-12 14:06:59,307::task::1168::TaskManager.Task::(prepare) Task=`89db2adf-bb98-4a6a-8767-bc2ef82b4c34`::finished: {} >Thread-1155::DEBUG::2013-12-12 14:06:59,308::task::579::TaskManager.Task::(_updateState) Task=`89db2adf-bb98-4a6a-8767-bc2ef82b4c34`::moving from state preparing -> state finished >Thread-1155::DEBUG::2013-12-12 14:06:59,308::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1155::DEBUG::2013-12-12 14:06:59,308::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1155::DEBUG::2013-12-12 14:06:59,308::task::974::TaskManager.Task::(_decref) Task=`89db2adf-bb98-4a6a-8767-bc2ef82b4c34`::ref 0 aborting False >Thread-1161::DEBUG::2013-12-12 14:07:14,523::task::579::TaskManager.Task::(_updateState) Task=`70f956e0-1ed7-40c9-adad-924143e4ef39`::moving from state init -> state preparing >Thread-1161::INFO::2013-12-12 14:07:14,523::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1161::INFO::2013-12-12 14:07:14,523::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1161::DEBUG::2013-12-12 14:07:14,523::task::1168::TaskManager.Task::(prepare) Task=`70f956e0-1ed7-40c9-adad-924143e4ef39`::finished: {} >Thread-1161::DEBUG::2013-12-12 14:07:14,523::task::579::TaskManager.Task::(_updateState) Task=`70f956e0-1ed7-40c9-adad-924143e4ef39`::moving from state preparing -> state finished >Thread-1161::DEBUG::2013-12-12 14:07:14,524::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1161::DEBUG::2013-12-12 14:07:14,524::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1161::DEBUG::2013-12-12 14:07:14,524::task::974::TaskManager.Task::(_decref) Task=`70f956e0-1ed7-40c9-adad-924143e4ef39`::ref 0 aborting False >Thread-1167::DEBUG::2013-12-12 14:07:29,655::task::579::TaskManager.Task::(_updateState) Task=`6a21c77e-efee-4255-95d4-c6f07f7fbf28`::moving from state init -> state preparing >Thread-1167::INFO::2013-12-12 14:07:29,655::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1167::INFO::2013-12-12 14:07:29,655::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1167::DEBUG::2013-12-12 14:07:29,655::task::1168::TaskManager.Task::(prepare) Task=`6a21c77e-efee-4255-95d4-c6f07f7fbf28`::finished: {} >Thread-1167::DEBUG::2013-12-12 14:07:29,655::task::579::TaskManager.Task::(_updateState) Task=`6a21c77e-efee-4255-95d4-c6f07f7fbf28`::moving from state preparing -> state finished >Thread-1167::DEBUG::2013-12-12 14:07:29,655::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1167::DEBUG::2013-12-12 14:07:29,656::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1167::DEBUG::2013-12-12 14:07:29,656::task::974::TaskManager.Task::(_decref) Task=`6a21c77e-efee-4255-95d4-c6f07f7fbf28`::ref 0 aborting False >Thread-1173::DEBUG::2013-12-12 14:07:44,814::task::579::TaskManager.Task::(_updateState) Task=`bc1497d7-19ae-4f30-b5a7-628fe5e60ed9`::moving from state init -> state preparing >Thread-1173::INFO::2013-12-12 14:07:44,814::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1173::INFO::2013-12-12 14:07:44,814::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1173::DEBUG::2013-12-12 14:07:44,814::task::1168::TaskManager.Task::(prepare) Task=`bc1497d7-19ae-4f30-b5a7-628fe5e60ed9`::finished: {} >Thread-1173::DEBUG::2013-12-12 14:07:44,814::task::579::TaskManager.Task::(_updateState) Task=`bc1497d7-19ae-4f30-b5a7-628fe5e60ed9`::moving from state preparing -> state finished >Thread-1173::DEBUG::2013-12-12 14:07:44,815::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1173::DEBUG::2013-12-12 14:07:44,815::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1173::DEBUG::2013-12-12 14:07:44,815::task::974::TaskManager.Task::(_decref) Task=`bc1497d7-19ae-4f30-b5a7-628fe5e60ed9`::ref 0 aborting False >Thread-1179::DEBUG::2013-12-12 14:07:59,925::task::579::TaskManager.Task::(_updateState) Task=`a4a5ba7e-f4b5-469a-92c1-b839aeda08d2`::moving from state init -> state preparing >Thread-1179::INFO::2013-12-12 14:07:59,925::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1179::INFO::2013-12-12 14:07:59,925::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1179::DEBUG::2013-12-12 14:07:59,925::task::1168::TaskManager.Task::(prepare) Task=`a4a5ba7e-f4b5-469a-92c1-b839aeda08d2`::finished: {} >Thread-1179::DEBUG::2013-12-12 14:07:59,926::task::579::TaskManager.Task::(_updateState) Task=`a4a5ba7e-f4b5-469a-92c1-b839aeda08d2`::moving from state preparing -> state finished >Thread-1179::DEBUG::2013-12-12 14:07:59,926::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1179::DEBUG::2013-12-12 14:07:59,926::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1179::DEBUG::2013-12-12 14:07:59,926::task::974::TaskManager.Task::(_decref) Task=`a4a5ba7e-f4b5-469a-92c1-b839aeda08d2`::ref 0 aborting False >Thread-1185::DEBUG::2013-12-12 14:08:15,097::task::579::TaskManager.Task::(_updateState) Task=`2c356573-550d-4b29-b13f-c0b5f9155ec1`::moving from state init -> state preparing >Thread-1185::INFO::2013-12-12 14:08:15,097::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1185::INFO::2013-12-12 14:08:15,097::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1185::DEBUG::2013-12-12 14:08:15,097::task::1168::TaskManager.Task::(prepare) Task=`2c356573-550d-4b29-b13f-c0b5f9155ec1`::finished: {} >Thread-1185::DEBUG::2013-12-12 14:08:15,098::task::579::TaskManager.Task::(_updateState) Task=`2c356573-550d-4b29-b13f-c0b5f9155ec1`::moving from state preparing -> state finished >Thread-1185::DEBUG::2013-12-12 14:08:15,098::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1185::DEBUG::2013-12-12 14:08:15,098::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1185::DEBUG::2013-12-12 14:08:15,098::task::974::TaskManager.Task::(_decref) Task=`2c356573-550d-4b29-b13f-c0b5f9155ec1`::ref 0 aborting False >Thread-1191::DEBUG::2013-12-12 14:08:30,225::task::579::TaskManager.Task::(_updateState) Task=`86db8ae0-eb1f-4178-8328-14f212be371d`::moving from state init -> state preparing >Thread-1191::INFO::2013-12-12 14:08:30,225::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1191::INFO::2013-12-12 14:08:30,226::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1191::DEBUG::2013-12-12 14:08:30,226::task::1168::TaskManager.Task::(prepare) Task=`86db8ae0-eb1f-4178-8328-14f212be371d`::finished: {} >Thread-1191::DEBUG::2013-12-12 14:08:30,226::task::579::TaskManager.Task::(_updateState) Task=`86db8ae0-eb1f-4178-8328-14f212be371d`::moving from state preparing -> state finished >Thread-1191::DEBUG::2013-12-12 14:08:30,226::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1191::DEBUG::2013-12-12 14:08:30,226::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1191::DEBUG::2013-12-12 14:08:30,226::task::974::TaskManager.Task::(_decref) Task=`86db8ae0-eb1f-4178-8328-14f212be371d`::ref 0 aborting False >Thread-1197::DEBUG::2013-12-12 14:08:45,333::task::579::TaskManager.Task::(_updateState) Task=`1cf1aa29-a733-40e5-8a06-d83612922d17`::moving from state init -> state preparing >Thread-1197::INFO::2013-12-12 14:08:45,334::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1197::INFO::2013-12-12 14:08:45,334::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1197::DEBUG::2013-12-12 14:08:45,334::task::1168::TaskManager.Task::(prepare) Task=`1cf1aa29-a733-40e5-8a06-d83612922d17`::finished: {} >Thread-1197::DEBUG::2013-12-12 14:08:45,334::task::579::TaskManager.Task::(_updateState) Task=`1cf1aa29-a733-40e5-8a06-d83612922d17`::moving from state preparing -> state finished >Thread-1197::DEBUG::2013-12-12 14:08:45,334::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1197::DEBUG::2013-12-12 14:08:45,334::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1197::DEBUG::2013-12-12 14:08:45,335::task::974::TaskManager.Task::(_decref) Task=`1cf1aa29-a733-40e5-8a06-d83612922d17`::ref 0 aborting False >Thread-1203::DEBUG::2013-12-12 14:09:00,484::task::579::TaskManager.Task::(_updateState) Task=`0c6edea6-d930-4bb1-b8c0-0d22eb22f326`::moving from state init -> state preparing >Thread-1203::INFO::2013-12-12 14:09:00,484::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1203::INFO::2013-12-12 14:09:00,484::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1203::DEBUG::2013-12-12 14:09:00,485::task::1168::TaskManager.Task::(prepare) Task=`0c6edea6-d930-4bb1-b8c0-0d22eb22f326`::finished: {} >Thread-1203::DEBUG::2013-12-12 14:09:00,485::task::579::TaskManager.Task::(_updateState) Task=`0c6edea6-d930-4bb1-b8c0-0d22eb22f326`::moving from state preparing -> state finished >Thread-1203::DEBUG::2013-12-12 14:09:00,485::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1203::DEBUG::2013-12-12 14:09:00,485::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1203::DEBUG::2013-12-12 14:09:00,485::task::974::TaskManager.Task::(_decref) Task=`0c6edea6-d930-4bb1-b8c0-0d22eb22f326`::ref 0 aborting False >Thread-1209::DEBUG::2013-12-12 14:09:15,626::task::579::TaskManager.Task::(_updateState) Task=`b7fdd2be-43ad-4bca-b565-84163a459bcf`::moving from state init -> state preparing >Thread-1209::INFO::2013-12-12 14:09:15,626::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1209::INFO::2013-12-12 14:09:15,627::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1209::DEBUG::2013-12-12 14:09:15,627::task::1168::TaskManager.Task::(prepare) Task=`b7fdd2be-43ad-4bca-b565-84163a459bcf`::finished: {} >Thread-1209::DEBUG::2013-12-12 14:09:15,627::task::579::TaskManager.Task::(_updateState) Task=`b7fdd2be-43ad-4bca-b565-84163a459bcf`::moving from state preparing -> state finished >Thread-1209::DEBUG::2013-12-12 14:09:15,627::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1209::DEBUG::2013-12-12 14:09:15,627::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1209::DEBUG::2013-12-12 14:09:15,628::task::974::TaskManager.Task::(_decref) Task=`b7fdd2be-43ad-4bca-b565-84163a459bcf`::ref 0 aborting False >Thread-1215::DEBUG::2013-12-12 14:09:30,709::task::579::TaskManager.Task::(_updateState) Task=`93ecb9b5-34cf-416a-aea6-2e42c069030e`::moving from state init -> state preparing >Thread-1215::INFO::2013-12-12 14:09:30,709::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1215::INFO::2013-12-12 14:09:30,709::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1215::DEBUG::2013-12-12 14:09:30,710::task::1168::TaskManager.Task::(prepare) Task=`93ecb9b5-34cf-416a-aea6-2e42c069030e`::finished: {} >Thread-1215::DEBUG::2013-12-12 14:09:30,710::task::579::TaskManager.Task::(_updateState) Task=`93ecb9b5-34cf-416a-aea6-2e42c069030e`::moving from state preparing -> state finished >Thread-1215::DEBUG::2013-12-12 14:09:30,710::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1215::DEBUG::2013-12-12 14:09:30,710::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1215::DEBUG::2013-12-12 14:09:30,710::task::974::TaskManager.Task::(_decref) Task=`93ecb9b5-34cf-416a-aea6-2e42c069030e`::ref 0 aborting False >Thread-1221::DEBUG::2013-12-12 14:09:45,802::task::579::TaskManager.Task::(_updateState) Task=`ebd5ed46-afd7-415b-9705-e840319dceeb`::moving from state init -> state preparing >Thread-1221::INFO::2013-12-12 14:09:45,802::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1221::INFO::2013-12-12 14:09:45,802::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1221::DEBUG::2013-12-12 14:09:45,802::task::1168::TaskManager.Task::(prepare) Task=`ebd5ed46-afd7-415b-9705-e840319dceeb`::finished: {} >Thread-1221::DEBUG::2013-12-12 14:09:45,802::task::579::TaskManager.Task::(_updateState) Task=`ebd5ed46-afd7-415b-9705-e840319dceeb`::moving from state preparing -> state finished >Thread-1221::DEBUG::2013-12-12 14:09:45,803::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1221::DEBUG::2013-12-12 14:09:45,803::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1221::DEBUG::2013-12-12 14:09:45,803::task::974::TaskManager.Task::(_decref) Task=`ebd5ed46-afd7-415b-9705-e840319dceeb`::ref 0 aborting False >Thread-1227::DEBUG::2013-12-12 14:10:00,899::task::579::TaskManager.Task::(_updateState) Task=`b6d5f603-59ba-4c8b-8a1b-e92817d64369`::moving from state init -> state preparing >Thread-1227::INFO::2013-12-12 14:10:00,899::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1227::INFO::2013-12-12 14:10:00,899::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1227::DEBUG::2013-12-12 14:10:00,899::task::1168::TaskManager.Task::(prepare) Task=`b6d5f603-59ba-4c8b-8a1b-e92817d64369`::finished: {} >Thread-1227::DEBUG::2013-12-12 14:10:00,899::task::579::TaskManager.Task::(_updateState) Task=`b6d5f603-59ba-4c8b-8a1b-e92817d64369`::moving from state preparing -> state finished >Thread-1227::DEBUG::2013-12-12 14:10:00,900::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1227::DEBUG::2013-12-12 14:10:00,900::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1227::DEBUG::2013-12-12 14:10:00,900::task::974::TaskManager.Task::(_decref) Task=`b6d5f603-59ba-4c8b-8a1b-e92817d64369`::ref 0 aborting False >Thread-1229::DEBUG::2013-12-12 14:10:03,728::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getCapabilities with () {} flowID [697068ad] >Thread-1229::DEBUG::2013-12-12 14:10:03,729::utils::489::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-1229::DEBUG::2013-12-12 14:10:03,733::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1229::DEBUG::2013-12-12 14:10:03,745::caps::363::root::(_getKeyPackages) rpm package glusterfs-rdma not found >Thread-1229::DEBUG::2013-12-12 14:10:03,746::caps::363::root::(_getKeyPackages) rpm package glusterfs-fuse not found >Thread-1229::DEBUG::2013-12-12 14:10:03,746::caps::363::root::(_getKeyPackages) rpm package gluster-swift not found >Thread-1229::DEBUG::2013-12-12 14:10:03,747::caps::363::root::(_getKeyPackages) rpm package qemu-kvm-rhev not found >Thread-1229::DEBUG::2013-12-12 14:10:03,747::caps::363::root::(_getKeyPackages) rpm package gluster-swift-object not found >Thread-1229::DEBUG::2013-12-12 14:10:03,748::caps::363::root::(_getKeyPackages) rpm package glusterfs not found >Thread-1229::DEBUG::2013-12-12 14:10:03,748::caps::363::root::(_getKeyPackages) rpm package gluster-swift-plugin not found >Thread-1229::DEBUG::2013-12-12 14:10:03,749::caps::363::root::(_getKeyPackages) rpm package qemu-img-rhev not found >Thread-1229::DEBUG::2013-12-12 14:10:03,749::caps::363::root::(_getKeyPackages) rpm package ('mom',) not found >Thread-1229::DEBUG::2013-12-12 14:10:03,750::caps::363::root::(_getKeyPackages) rpm package gluster-swift-account not found >Thread-1229::DEBUG::2013-12-12 14:10:03,750::caps::363::root::(_getKeyPackages) rpm package gluster-swift-proxy not found >Thread-1229::DEBUG::2013-12-12 14:10:03,750::caps::363::root::(_getKeyPackages) rpm package gluster-swift-doc not found >Thread-1229::DEBUG::2013-12-12 14:10:03,751::caps::363::root::(_getKeyPackages) rpm package glusterfs-server not found >Thread-1229::DEBUG::2013-12-12 14:10:03,751::caps::363::root::(_getKeyPackages) rpm package gluster-swift-container not found >Thread-1229::DEBUG::2013-12-12 14:10:03,751::caps::363::root::(_getKeyPackages) rpm package glusterfs-geo-replication not found >Thread-1229::DEBUG::2013-12-12 14:10:03,752::BindingXMLRPC::991::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.28.1.el6.x86_64', 'buildtime': 1384533955.0, 'version': '2.6.32'}, 'vdsm': {'release': '23.1.el6rhs', 'buildtime': 1386773756L, 'version': '4.13.0'}, 'spice-server': {'release': '12.el6_4.5', 'buildtime': 1381834662L, 'version': '0.12.0'}, 'libvirt': {'release': '18.el6_4.13', 'buildtime': 1379320058L, 'version': '0.10.2'}}, 'cpuModel': 'QEMU Virtual CPU version 1.4.2', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.14.16.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.14.16.254', 'ports': ['eth0']}}, 'uuid': '7B904C94-94EE-7B49-40B3-BD3C28FBB749', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'netmask': '', 'addr': '', 'hwaddr': '52:54:00:b7:60:bc', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': '52:54:00:b7:60:bc', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 100, 'mtu': '1500'}}, 'software_revision': '23.1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': 'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,lm,up,rep_good,unfair_spinlock,pni,cx16,popcnt,hypervisor,lahf_lm', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '4062', 'cpuSpeed': '2393.998', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '1', 'kvmEnabled': 'false', 'rhsVersion': {'release': '1.el6rhs', 'version': '2.1.2.0', 'name': 'RHS'}, 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '1', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.14.16.112'}} >Thread-1230::DEBUG::2013-12-12 14:10:03,763::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getHardwareInfo with () {} flowID [697068ad] >Thread-1230::DEBUG::2013-12-12 14:10:03,765::BindingXMLRPC::991::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'Bochs', 'systemSerialNumber': 'Not Specified', 'systemFamily': 'Not Specified', 'systemVersion': 'Not Specified', 'systemUUID': '7b904c94-94ee-7b49-40b3-bd3c28fbb749', 'systemManufacturer': 'Bochs'}} >Thread-1231::DEBUG::2013-12-12 14:10:03,788::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} flowID [697068ad] >Thread-1231::ERROR::2013-12-12 14:10:06,796::BindingXMLRPC::1000::vds::(wrapper) vdsm exception occured >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 989, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 53, in wrapper > rv = func(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 229, in hostsList > return {'hosts': self.svdsmProxy.glusterPeerStatus()} > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in glusterPeerStatus > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >GlusterCmdExecFailedException: Command execution failed >error: Connection failed. Please check if gluster daemon is operational. >return code: 1 >Thread-1236::DEBUG::2013-12-12 14:10:19,115::task::579::TaskManager.Task::(_updateState) Task=`6d0c4871-700f-4490-a7c9-4fae8c7b8697`::moving from state init -> state preparing >Thread-1236::INFO::2013-12-12 14:10:19,116::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1236::INFO::2013-12-12 14:10:19,116::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1236::DEBUG::2013-12-12 14:10:19,116::task::1168::TaskManager.Task::(prepare) Task=`6d0c4871-700f-4490-a7c9-4fae8c7b8697`::finished: {} >Thread-1236::DEBUG::2013-12-12 14:10:19,116::task::579::TaskManager.Task::(_updateState) Task=`6d0c4871-700f-4490-a7c9-4fae8c7b8697`::moving from state preparing -> state finished >Thread-1236::DEBUG::2013-12-12 14:10:19,116::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1236::DEBUG::2013-12-12 14:10:19,117::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1236::DEBUG::2013-12-12 14:10:19,117::task::974::TaskManager.Task::(_decref) Task=`6d0c4871-700f-4490-a7c9-4fae8c7b8697`::ref 0 aborting False >Thread-1242::DEBUG::2013-12-12 14:10:34,204::task::579::TaskManager.Task::(_updateState) Task=`2f44acbf-bc56-40c5-8501-e115a58b4c74`::moving from state init -> state preparing >Thread-1242::INFO::2013-12-12 14:10:34,204::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1242::INFO::2013-12-12 14:10:34,205::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1242::DEBUG::2013-12-12 14:10:34,205::task::1168::TaskManager.Task::(prepare) Task=`2f44acbf-bc56-40c5-8501-e115a58b4c74`::finished: {} >Thread-1242::DEBUG::2013-12-12 14:10:34,205::task::579::TaskManager.Task::(_updateState) Task=`2f44acbf-bc56-40c5-8501-e115a58b4c74`::moving from state preparing -> state finished >Thread-1242::DEBUG::2013-12-12 14:10:34,205::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1242::DEBUG::2013-12-12 14:10:34,205::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1242::DEBUG::2013-12-12 14:10:34,205::task::974::TaskManager.Task::(_decref) Task=`2f44acbf-bc56-40c5-8501-e115a58b4c74`::ref 0 aborting False >Thread-1248::DEBUG::2013-12-12 14:10:49,282::task::579::TaskManager.Task::(_updateState) Task=`e705156a-d9f4-4762-aff3-4927844911fd`::moving from state init -> state preparing >Thread-1248::INFO::2013-12-12 14:10:49,283::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1248::INFO::2013-12-12 14:10:49,283::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1248::DEBUG::2013-12-12 14:10:49,283::task::1168::TaskManager.Task::(prepare) Task=`e705156a-d9f4-4762-aff3-4927844911fd`::finished: {} >Thread-1248::DEBUG::2013-12-12 14:10:49,283::task::579::TaskManager.Task::(_updateState) Task=`e705156a-d9f4-4762-aff3-4927844911fd`::moving from state preparing -> state finished >Thread-1248::DEBUG::2013-12-12 14:10:49,283::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1248::DEBUG::2013-12-12 14:10:49,283::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1248::DEBUG::2013-12-12 14:10:49,284::task::974::TaskManager.Task::(_decref) Task=`e705156a-d9f4-4762-aff3-4927844911fd`::ref 0 aborting False >Thread-1254::DEBUG::2013-12-12 14:11:04,367::task::579::TaskManager.Task::(_updateState) Task=`5a81027c-30c3-4e37-8748-f36a1fcf6813`::moving from state init -> state preparing >Thread-1254::INFO::2013-12-12 14:11:04,367::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1254::INFO::2013-12-12 14:11:04,367::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1254::DEBUG::2013-12-12 14:11:04,367::task::1168::TaskManager.Task::(prepare) Task=`5a81027c-30c3-4e37-8748-f36a1fcf6813`::finished: {} >Thread-1254::DEBUG::2013-12-12 14:11:04,368::task::579::TaskManager.Task::(_updateState) Task=`5a81027c-30c3-4e37-8748-f36a1fcf6813`::moving from state preparing -> state finished >Thread-1254::DEBUG::2013-12-12 14:11:04,368::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1254::DEBUG::2013-12-12 14:11:04,368::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1254::DEBUG::2013-12-12 14:11:04,368::task::974::TaskManager.Task::(_decref) Task=`5a81027c-30c3-4e37-8748-f36a1fcf6813`::ref 0 aborting False >Thread-1260::DEBUG::2013-12-12 14:11:19,450::task::579::TaskManager.Task::(_updateState) Task=`2095dc81-4c5e-475f-af1a-f0a2313f4279`::moving from state init -> state preparing >Thread-1260::INFO::2013-12-12 14:11:19,451::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1260::INFO::2013-12-12 14:11:19,451::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1260::DEBUG::2013-12-12 14:11:19,451::task::1168::TaskManager.Task::(prepare) Task=`2095dc81-4c5e-475f-af1a-f0a2313f4279`::finished: {} >Thread-1260::DEBUG::2013-12-12 14:11:19,451::task::579::TaskManager.Task::(_updateState) Task=`2095dc81-4c5e-475f-af1a-f0a2313f4279`::moving from state preparing -> state finished >Thread-1260::DEBUG::2013-12-12 14:11:19,452::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1260::DEBUG::2013-12-12 14:11:19,452::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1260::DEBUG::2013-12-12 14:11:19,452::task::974::TaskManager.Task::(_decref) Task=`2095dc81-4c5e-475f-af1a-f0a2313f4279`::ref 0 aborting False >Thread-1266::DEBUG::2013-12-12 14:11:34,532::task::579::TaskManager.Task::(_updateState) Task=`f351224f-675f-4142-8d45-ffd8fbbff2f6`::moving from state init -> state preparing >Thread-1266::INFO::2013-12-12 14:11:34,532::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1266::INFO::2013-12-12 14:11:34,533::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1266::DEBUG::2013-12-12 14:11:34,533::task::1168::TaskManager.Task::(prepare) Task=`f351224f-675f-4142-8d45-ffd8fbbff2f6`::finished: {} >Thread-1266::DEBUG::2013-12-12 14:11:34,533::task::579::TaskManager.Task::(_updateState) Task=`f351224f-675f-4142-8d45-ffd8fbbff2f6`::moving from state preparing -> state finished >Thread-1266::DEBUG::2013-12-12 14:11:34,534::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1266::DEBUG::2013-12-12 14:11:34,534::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1266::DEBUG::2013-12-12 14:11:34,534::task::974::TaskManager.Task::(_decref) Task=`f351224f-675f-4142-8d45-ffd8fbbff2f6`::ref 0 aborting False >Thread-1272::DEBUG::2013-12-12 14:11:49,613::task::579::TaskManager.Task::(_updateState) Task=`d3aa9efd-11ce-483a-9c1c-b5cf43ecda8b`::moving from state init -> state preparing >Thread-1272::INFO::2013-12-12 14:11:49,613::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1272::INFO::2013-12-12 14:11:49,613::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1272::DEBUG::2013-12-12 14:11:49,613::task::1168::TaskManager.Task::(prepare) Task=`d3aa9efd-11ce-483a-9c1c-b5cf43ecda8b`::finished: {} >Thread-1272::DEBUG::2013-12-12 14:11:49,614::task::579::TaskManager.Task::(_updateState) Task=`d3aa9efd-11ce-483a-9c1c-b5cf43ecda8b`::moving from state preparing -> state finished >Thread-1272::DEBUG::2013-12-12 14:11:49,614::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1272::DEBUG::2013-12-12 14:11:49,614::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1272::DEBUG::2013-12-12 14:11:49,614::task::974::TaskManager.Task::(_decref) Task=`d3aa9efd-11ce-483a-9c1c-b5cf43ecda8b`::ref 0 aborting False >Thread-1278::DEBUG::2013-12-12 14:12:04,697::task::579::TaskManager.Task::(_updateState) Task=`093c7750-4970-4f7c-8b40-b81589571b9b`::moving from state init -> state preparing >Thread-1278::INFO::2013-12-12 14:12:04,698::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1278::INFO::2013-12-12 14:12:04,698::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1278::DEBUG::2013-12-12 14:12:04,698::task::1168::TaskManager.Task::(prepare) Task=`093c7750-4970-4f7c-8b40-b81589571b9b`::finished: {} >Thread-1278::DEBUG::2013-12-12 14:12:04,698::task::579::TaskManager.Task::(_updateState) Task=`093c7750-4970-4f7c-8b40-b81589571b9b`::moving from state preparing -> state finished >Thread-1278::DEBUG::2013-12-12 14:12:04,698::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1278::DEBUG::2013-12-12 14:12:04,699::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1278::DEBUG::2013-12-12 14:12:04,699::task::974::TaskManager.Task::(_decref) Task=`093c7750-4970-4f7c-8b40-b81589571b9b`::ref 0 aborting False >Thread-1284::DEBUG::2013-12-12 14:12:19,788::task::579::TaskManager.Task::(_updateState) Task=`f4ba712e-118d-4bb5-8113-f7bbf0cf1ddf`::moving from state init -> state preparing >Thread-1284::INFO::2013-12-12 14:12:19,788::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1284::INFO::2013-12-12 14:12:19,788::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1284::DEBUG::2013-12-12 14:12:19,788::task::1168::TaskManager.Task::(prepare) Task=`f4ba712e-118d-4bb5-8113-f7bbf0cf1ddf`::finished: {} >Thread-1284::DEBUG::2013-12-12 14:12:19,789::task::579::TaskManager.Task::(_updateState) Task=`f4ba712e-118d-4bb5-8113-f7bbf0cf1ddf`::moving from state preparing -> state finished >Thread-1284::DEBUG::2013-12-12 14:12:19,789::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1284::DEBUG::2013-12-12 14:12:19,789::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1284::DEBUG::2013-12-12 14:12:19,789::task::974::TaskManager.Task::(_decref) Task=`f4ba712e-118d-4bb5-8113-f7bbf0cf1ddf`::ref 0 aborting False >Thread-1290::DEBUG::2013-12-12 14:12:34,914::task::579::TaskManager.Task::(_updateState) Task=`9cad8d3c-60fd-446e-8e3f-2f2fcff76084`::moving from state init -> state preparing >Thread-1290::INFO::2013-12-12 14:12:34,914::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1290::INFO::2013-12-12 14:12:34,914::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1290::DEBUG::2013-12-12 14:12:34,914::task::1168::TaskManager.Task::(prepare) Task=`9cad8d3c-60fd-446e-8e3f-2f2fcff76084`::finished: {} >Thread-1290::DEBUG::2013-12-12 14:12:34,914::task::579::TaskManager.Task::(_updateState) Task=`9cad8d3c-60fd-446e-8e3f-2f2fcff76084`::moving from state preparing -> state finished >Thread-1290::DEBUG::2013-12-12 14:12:34,915::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1290::DEBUG::2013-12-12 14:12:34,915::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1290::DEBUG::2013-12-12 14:12:34,915::task::974::TaskManager.Task::(_decref) Task=`9cad8d3c-60fd-446e-8e3f-2f2fcff76084`::ref 0 aborting False >Thread-1296::DEBUG::2013-12-12 14:12:50,007::task::579::TaskManager.Task::(_updateState) Task=`1832fffb-fc8b-4518-9692-e0b7fac0f805`::moving from state init -> state preparing >Thread-1296::INFO::2013-12-12 14:12:50,007::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1296::INFO::2013-12-12 14:12:50,008::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1296::DEBUG::2013-12-12 14:12:50,008::task::1168::TaskManager.Task::(prepare) Task=`1832fffb-fc8b-4518-9692-e0b7fac0f805`::finished: {} >Thread-1296::DEBUG::2013-12-12 14:12:50,008::task::579::TaskManager.Task::(_updateState) Task=`1832fffb-fc8b-4518-9692-e0b7fac0f805`::moving from state preparing -> state finished >Thread-1296::DEBUG::2013-12-12 14:12:50,008::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1296::DEBUG::2013-12-12 14:12:50,009::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1296::DEBUG::2013-12-12 14:12:50,009::task::974::TaskManager.Task::(_decref) Task=`1832fffb-fc8b-4518-9692-e0b7fac0f805`::ref 0 aborting False >Thread-1302::DEBUG::2013-12-12 14:13:05,133::task::579::TaskManager.Task::(_updateState) Task=`2e7de295-2a1d-4b78-bad3-1aa55433131a`::moving from state init -> state preparing >Thread-1302::INFO::2013-12-12 14:13:05,133::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1302::INFO::2013-12-12 14:13:05,133::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1302::DEBUG::2013-12-12 14:13:05,134::task::1168::TaskManager.Task::(prepare) Task=`2e7de295-2a1d-4b78-bad3-1aa55433131a`::finished: {} >Thread-1302::DEBUG::2013-12-12 14:13:05,134::task::579::TaskManager.Task::(_updateState) Task=`2e7de295-2a1d-4b78-bad3-1aa55433131a`::moving from state preparing -> state finished >Thread-1302::DEBUG::2013-12-12 14:13:05,134::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1302::DEBUG::2013-12-12 14:13:05,134::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1302::DEBUG::2013-12-12 14:13:05,134::task::974::TaskManager.Task::(_decref) Task=`2e7de295-2a1d-4b78-bad3-1aa55433131a`::ref 0 aborting False >Thread-1308::DEBUG::2013-12-12 14:13:20,243::task::579::TaskManager.Task::(_updateState) Task=`935c09e1-f8e2-4ae7-a857-730d9f2d459a`::moving from state init -> state preparing >Thread-1308::INFO::2013-12-12 14:13:20,244::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1308::INFO::2013-12-12 14:13:20,244::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1308::DEBUG::2013-12-12 14:13:20,244::task::1168::TaskManager.Task::(prepare) Task=`935c09e1-f8e2-4ae7-a857-730d9f2d459a`::finished: {} >Thread-1308::DEBUG::2013-12-12 14:13:20,244::task::579::TaskManager.Task::(_updateState) Task=`935c09e1-f8e2-4ae7-a857-730d9f2d459a`::moving from state preparing -> state finished >Thread-1308::DEBUG::2013-12-12 14:13:20,244::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1308::DEBUG::2013-12-12 14:13:20,245::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1308::DEBUG::2013-12-12 14:13:20,245::task::974::TaskManager.Task::(_decref) Task=`935c09e1-f8e2-4ae7-a857-730d9f2d459a`::ref 0 aborting False >Thread-1314::DEBUG::2013-12-12 14:13:35,399::task::579::TaskManager.Task::(_updateState) Task=`7d87c8de-7312-4b1d-912c-46fdc88cb161`::moving from state init -> state preparing >Thread-1314::INFO::2013-12-12 14:13:35,399::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1314::INFO::2013-12-12 14:13:35,399::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1314::DEBUG::2013-12-12 14:13:35,399::task::1168::TaskManager.Task::(prepare) Task=`7d87c8de-7312-4b1d-912c-46fdc88cb161`::finished: {} >Thread-1314::DEBUG::2013-12-12 14:13:35,400::task::579::TaskManager.Task::(_updateState) Task=`7d87c8de-7312-4b1d-912c-46fdc88cb161`::moving from state preparing -> state finished >Thread-1314::DEBUG::2013-12-12 14:13:35,400::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1314::DEBUG::2013-12-12 14:13:35,400::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1314::DEBUG::2013-12-12 14:13:35,400::task::974::TaskManager.Task::(_decref) Task=`7d87c8de-7312-4b1d-912c-46fdc88cb161`::ref 0 aborting False >Thread-1320::DEBUG::2013-12-12 14:13:50,517::task::579::TaskManager.Task::(_updateState) Task=`a86579f7-1573-46c7-9e7b-1192e32aca65`::moving from state init -> state preparing >Thread-1320::INFO::2013-12-12 14:13:50,518::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1320::INFO::2013-12-12 14:13:50,518::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1320::DEBUG::2013-12-12 14:13:50,518::task::1168::TaskManager.Task::(prepare) Task=`a86579f7-1573-46c7-9e7b-1192e32aca65`::finished: {} >Thread-1320::DEBUG::2013-12-12 14:13:50,518::task::579::TaskManager.Task::(_updateState) Task=`a86579f7-1573-46c7-9e7b-1192e32aca65`::moving from state preparing -> state finished >Thread-1320::DEBUG::2013-12-12 14:13:50,518::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1320::DEBUG::2013-12-12 14:13:50,519::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1320::DEBUG::2013-12-12 14:13:50,519::task::974::TaskManager.Task::(_decref) Task=`a86579f7-1573-46c7-9e7b-1192e32aca65`::ref 0 aborting False >Thread-1326::DEBUG::2013-12-12 14:14:05,615::task::579::TaskManager.Task::(_updateState) Task=`97a66efb-d1c1-4841-99bb-d44e5539d1fe`::moving from state init -> state preparing >Thread-1326::INFO::2013-12-12 14:14:05,615::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1326::INFO::2013-12-12 14:14:05,615::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1326::DEBUG::2013-12-12 14:14:05,615::task::1168::TaskManager.Task::(prepare) Task=`97a66efb-d1c1-4841-99bb-d44e5539d1fe`::finished: {} >Thread-1326::DEBUG::2013-12-12 14:14:05,616::task::579::TaskManager.Task::(_updateState) Task=`97a66efb-d1c1-4841-99bb-d44e5539d1fe`::moving from state preparing -> state finished >Thread-1326::DEBUG::2013-12-12 14:14:05,616::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1326::DEBUG::2013-12-12 14:14:05,616::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1326::DEBUG::2013-12-12 14:14:05,616::task::974::TaskManager.Task::(_decref) Task=`97a66efb-d1c1-4841-99bb-d44e5539d1fe`::ref 0 aborting False >Thread-1332::DEBUG::2013-12-12 14:14:20,772::task::579::TaskManager.Task::(_updateState) Task=`ed1d0bc6-bc84-44b8-8dd4-fab8a8fcc876`::moving from state init -> state preparing >Thread-1332::INFO::2013-12-12 14:14:20,773::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1332::INFO::2013-12-12 14:14:20,773::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1332::DEBUG::2013-12-12 14:14:20,773::task::1168::TaskManager.Task::(prepare) Task=`ed1d0bc6-bc84-44b8-8dd4-fab8a8fcc876`::finished: {} >Thread-1332::DEBUG::2013-12-12 14:14:20,773::task::579::TaskManager.Task::(_updateState) Task=`ed1d0bc6-bc84-44b8-8dd4-fab8a8fcc876`::moving from state preparing -> state finished >Thread-1332::DEBUG::2013-12-12 14:14:20,773::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1332::DEBUG::2013-12-12 14:14:20,774::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1332::DEBUG::2013-12-12 14:14:20,774::task::974::TaskManager.Task::(_decref) Task=`ed1d0bc6-bc84-44b8-8dd4-fab8a8fcc876`::ref 0 aborting False >Thread-1338::DEBUG::2013-12-12 14:14:35,869::task::579::TaskManager.Task::(_updateState) Task=`9a086af2-37d8-4035-aaa6-7888a47d9333`::moving from state init -> state preparing >Thread-1338::INFO::2013-12-12 14:14:35,869::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1338::INFO::2013-12-12 14:14:35,870::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1338::DEBUG::2013-12-12 14:14:35,870::task::1168::TaskManager.Task::(prepare) Task=`9a086af2-37d8-4035-aaa6-7888a47d9333`::finished: {} >Thread-1338::DEBUG::2013-12-12 14:14:35,870::task::579::TaskManager.Task::(_updateState) Task=`9a086af2-37d8-4035-aaa6-7888a47d9333`::moving from state preparing -> state finished >Thread-1338::DEBUG::2013-12-12 14:14:35,870::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1338::DEBUG::2013-12-12 14:14:35,871::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1338::DEBUG::2013-12-12 14:14:35,871::task::974::TaskManager.Task::(_decref) Task=`9a086af2-37d8-4035-aaa6-7888a47d9333`::ref 0 aborting False >Thread-1344::DEBUG::2013-12-12 14:14:50,965::task::579::TaskManager.Task::(_updateState) Task=`da8c9a3b-e34d-4747-9954-526201231382`::moving from state init -> state preparing >Thread-1344::INFO::2013-12-12 14:14:50,965::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1344::INFO::2013-12-12 14:14:50,965::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1344::DEBUG::2013-12-12 14:14:50,966::task::1168::TaskManager.Task::(prepare) Task=`da8c9a3b-e34d-4747-9954-526201231382`::finished: {} >Thread-1344::DEBUG::2013-12-12 14:14:50,966::task::579::TaskManager.Task::(_updateState) Task=`da8c9a3b-e34d-4747-9954-526201231382`::moving from state preparing -> state finished >Thread-1344::DEBUG::2013-12-12 14:14:50,966::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1344::DEBUG::2013-12-12 14:14:50,966::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1344::DEBUG::2013-12-12 14:14:50,966::task::974::TaskManager.Task::(_decref) Task=`da8c9a3b-e34d-4747-9954-526201231382`::ref 0 aborting False >Thread-1350::DEBUG::2013-12-12 14:15:03,763::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getCapabilities with () {} flowID [50fc60c] >Thread-1350::DEBUG::2013-12-12 14:15:03,763::utils::489::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-1350::DEBUG::2013-12-12 14:15:03,768::utils::509::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1350::DEBUG::2013-12-12 14:15:03,780::caps::363::root::(_getKeyPackages) rpm package glusterfs-rdma not found >Thread-1350::DEBUG::2013-12-12 14:15:03,780::caps::363::root::(_getKeyPackages) rpm package glusterfs-fuse not found >Thread-1350::DEBUG::2013-12-12 14:15:03,781::caps::363::root::(_getKeyPackages) rpm package gluster-swift not found >Thread-1350::DEBUG::2013-12-12 14:15:03,781::caps::363::root::(_getKeyPackages) rpm package qemu-kvm-rhev not found >Thread-1350::DEBUG::2013-12-12 14:15:03,782::caps::363::root::(_getKeyPackages) rpm package gluster-swift-object not found >Thread-1350::DEBUG::2013-12-12 14:15:03,782::caps::363::root::(_getKeyPackages) rpm package glusterfs not found >Thread-1350::DEBUG::2013-12-12 14:15:03,782::caps::363::root::(_getKeyPackages) rpm package gluster-swift-plugin not found >Thread-1350::DEBUG::2013-12-12 14:15:03,784::caps::363::root::(_getKeyPackages) rpm package qemu-img-rhev not found >Thread-1350::DEBUG::2013-12-12 14:15:03,784::caps::363::root::(_getKeyPackages) rpm package ('mom',) not found >Thread-1350::DEBUG::2013-12-12 14:15:03,784::caps::363::root::(_getKeyPackages) rpm package gluster-swift-account not found >Thread-1350::DEBUG::2013-12-12 14:15:03,784::caps::363::root::(_getKeyPackages) rpm package gluster-swift-proxy not found >Thread-1350::DEBUG::2013-12-12 14:15:03,785::caps::363::root::(_getKeyPackages) rpm package gluster-swift-doc not found >Thread-1350::DEBUG::2013-12-12 14:15:03,785::caps::363::root::(_getKeyPackages) rpm package glusterfs-server not found >Thread-1350::DEBUG::2013-12-12 14:15:03,785::caps::363::root::(_getKeyPackages) rpm package gluster-swift-container not found >Thread-1350::DEBUG::2013-12-12 14:15:03,786::caps::363::root::(_getKeyPackages) rpm package glusterfs-geo-replication not found >Thread-1350::DEBUG::2013-12-12 14:15:03,786::BindingXMLRPC::991::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f'}], 'FC': []}, 'packages2': {'kernel': {'release': '358.28.1.el6.x86_64', 'buildtime': 1384533955.0, 'version': '2.6.32'}, 'vdsm': {'release': '23.1.el6rhs', 'buildtime': 1386773756L, 'version': '4.13.0'}, 'spice-server': {'release': '12.el6_4.5', 'buildtime': 1381834662L, 'version': '0.12.0'}, 'libvirt': {'release': '18.el6_4.13', 'buildtime': 1379320058L, 'version': '0.10.2'}}, 'cpuModel': 'QEMU Virtual CPU version 1.4.2', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.14.16.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.14.16.127', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.14.16.254', 'ports': ['eth0']}}, 'uuid': '7B904C94-94EE-7B49-40B3-BD3C28FBB749', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'netmask': '', 'addr': '', 'hwaddr': '52:54:00:b7:60:bc', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': '52:54:00:b7:60:bc', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 100, 'mtu': '1500'}}, 'software_revision': '23.1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': 'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,lm,up,rep_good,unfair_spinlock,pni,cx16,popcnt,hypervisor,lahf_lm', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:3bebc8fac26f', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '4062', 'cpuSpeed': '2393.998', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '1', 'kvmEnabled': 'false', 'rhsVersion': {'release': '1.el6rhs', 'version': '2.1.2.0', 'name': 'RHS'}, 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '1', 'emulatedMachines': [u'rhel6.4.0', u'pc', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.4.0.4.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.14.16.112'}} >Thread-1351::DEBUG::2013-12-12 14:15:03,797::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call getHardwareInfo with () {} flowID [50fc60c] >Thread-1351::DEBUG::2013-12-12 14:15:03,799::BindingXMLRPC::991::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'Bochs', 'systemSerialNumber': 'Not Specified', 'systemFamily': 'Not Specified', 'systemVersion': 'Not Specified', 'systemUUID': '7b904c94-94ee-7b49-40b3-bd3c28fbb749', 'systemManufacturer': 'Bochs'}} >Thread-1352::DEBUG::2013-12-12 14:15:03,823::BindingXMLRPC::984::vds::(wrapper) client [10.14.16.112]::call hostsList with () {} flowID [50fc60c] >Thread-1352::ERROR::2013-12-12 14:15:06,831::BindingXMLRPC::1000::vds::(wrapper) vdsm exception occured >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 989, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 53, in wrapper > rv = func(*args, **kwargs) > File "/usr/share/vdsm/gluster/api.py", line 229, in hostsList > return {'hosts': self.svdsmProxy.glusterPeerStatus()} > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in glusterPeerStatus > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >GlusterCmdExecFailedException: Command execution failed >error: Connection failed. Please check if gluster daemon is operational. >return code: 1 >Thread-1353::DEBUG::2013-12-12 14:15:09,046::task::579::TaskManager.Task::(_updateState) Task=`851f9090-b92f-49ef-873d-3267bff291b9`::moving from state init -> state preparing >Thread-1353::INFO::2013-12-12 14:15:09,046::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1353::INFO::2013-12-12 14:15:09,047::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1353::DEBUG::2013-12-12 14:15:09,047::task::1168::TaskManager.Task::(prepare) Task=`851f9090-b92f-49ef-873d-3267bff291b9`::finished: {} >Thread-1353::DEBUG::2013-12-12 14:15:09,047::task::579::TaskManager.Task::(_updateState) Task=`851f9090-b92f-49ef-873d-3267bff291b9`::moving from state preparing -> state finished >Thread-1353::DEBUG::2013-12-12 14:15:09,047::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1353::DEBUG::2013-12-12 14:15:09,047::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1353::DEBUG::2013-12-12 14:15:09,047::task::974::TaskManager.Task::(_decref) Task=`851f9090-b92f-49ef-873d-3267bff291b9`::ref 0 aborting False >Thread-1359::DEBUG::2013-12-12 14:15:24,163::task::579::TaskManager.Task::(_updateState) Task=`f5136ef1-15c6-4116-acfd-77a81becff1c`::moving from state init -> state preparing >Thread-1359::INFO::2013-12-12 14:15:24,163::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1359::INFO::2013-12-12 14:15:24,163::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1359::DEBUG::2013-12-12 14:15:24,164::task::1168::TaskManager.Task::(prepare) Task=`f5136ef1-15c6-4116-acfd-77a81becff1c`::finished: {} >Thread-1359::DEBUG::2013-12-12 14:15:24,164::task::579::TaskManager.Task::(_updateState) Task=`f5136ef1-15c6-4116-acfd-77a81becff1c`::moving from state preparing -> state finished >Thread-1359::DEBUG::2013-12-12 14:15:24,164::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1359::DEBUG::2013-12-12 14:15:24,164::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1359::DEBUG::2013-12-12 14:15:24,164::task::974::TaskManager.Task::(_decref) Task=`f5136ef1-15c6-4116-acfd-77a81becff1c`::ref 0 aborting False >Thread-1365::DEBUG::2013-12-12 14:15:39,286::task::579::TaskManager.Task::(_updateState) Task=`6efe8e2f-9654-4409-b63b-806a3a2d582a`::moving from state init -> state preparing >Thread-1365::INFO::2013-12-12 14:15:39,286::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1365::INFO::2013-12-12 14:15:39,286::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1365::DEBUG::2013-12-12 14:15:39,286::task::1168::TaskManager.Task::(prepare) Task=`6efe8e2f-9654-4409-b63b-806a3a2d582a`::finished: {} >Thread-1365::DEBUG::2013-12-12 14:15:39,286::task::579::TaskManager.Task::(_updateState) Task=`6efe8e2f-9654-4409-b63b-806a3a2d582a`::moving from state preparing -> state finished >Thread-1365::DEBUG::2013-12-12 14:15:39,287::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1365::DEBUG::2013-12-12 14:15:39,287::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1365::DEBUG::2013-12-12 14:15:39,287::task::974::TaskManager.Task::(_decref) Task=`6efe8e2f-9654-4409-b63b-806a3a2d582a`::ref 0 aborting False >Thread-1371::DEBUG::2013-12-12 14:15:54,521::task::579::TaskManager.Task::(_updateState) Task=`b2158c13-9aa9-47ae-8964-acb5ad8d0857`::moving from state init -> state preparing >Thread-1371::INFO::2013-12-12 14:15:54,521::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1371::INFO::2013-12-12 14:15:54,522::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1371::DEBUG::2013-12-12 14:15:54,522::task::1168::TaskManager.Task::(prepare) Task=`b2158c13-9aa9-47ae-8964-acb5ad8d0857`::finished: {} >Thread-1371::DEBUG::2013-12-12 14:15:54,522::task::579::TaskManager.Task::(_updateState) Task=`b2158c13-9aa9-47ae-8964-acb5ad8d0857`::moving from state preparing -> state finished >Thread-1371::DEBUG::2013-12-12 14:15:54,522::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1371::DEBUG::2013-12-12 14:15:54,522::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1371::DEBUG::2013-12-12 14:15:54,522::task::974::TaskManager.Task::(_decref) Task=`b2158c13-9aa9-47ae-8964-acb5ad8d0857`::ref 0 aborting False >Thread-1377::DEBUG::2013-12-12 14:16:09,637::task::579::TaskManager.Task::(_updateState) Task=`65ccb193-7723-48e7-b7ee-f36cf5973f33`::moving from state init -> state preparing >Thread-1377::INFO::2013-12-12 14:16:09,637::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1377::INFO::2013-12-12 14:16:09,637::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-1377::DEBUG::2013-12-12 14:16:09,637::task::1168::TaskManager.Task::(prepare) Task=`65ccb193-7723-48e7-b7ee-f36cf5973f33`::finished: {} >Thread-1377::DEBUG::2013-12-12 14:16:09,637::task::579::TaskManager.Task::(_updateState) Task=`65ccb193-7723-48e7-b7ee-f36cf5973f33`::moving from state preparing -> state finished >Thread-1377::DEBUG::2013-12-12 14:16:09,638::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-1377::DEBUG::2013-12-12 14:16:09,638::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-1377::DEBUG::2013-12-12 14:16:09,638::task::974::TaskManager.Task::(_decref) Task=`65ccb193-7723-48e7-b7ee-f36cf5973f33`::ref 0 aborting False
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1041857
:
836010
| 836012 |
836013