Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 935730 Details for
Bug 1139401
[JSONRPC] Unable to select host as SPM due to InquireNotSupportedError
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
Full vdsm log
vdsm.log (text/plain), 304.42 KB, created by
Adam Litke
on 2014-09-09 13:57:54 UTC
(
hide
)
Description:
Full vdsm log
Filename:
MIME Type:
Creator:
Adam Litke
Created:
2014-09-09 13:57:54 UTC
Size:
304.42 KB
patch
obsolete
>I am the actual vdsm 4.16.3-24.git16e82fe.fc20 ale.alitke.net (3.11.10-301.fc20.x86_64) >MainThread::DEBUG::2014-09-09 09:54:14,097::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2014-09-09 09:54:14,097::threadPool::35::Storage.ThreadPool::(__init__) Enter - numThreads: 10, waitTimeout: 3, maxTasks: 500 >MainThread::DEBUG::2014-09-09 09:54:14,099::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt >MainThread::WARNING::2014-09-09 09:54:14,099::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2014-09-09 09:54:14,116::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::DEBUG::2014-09-09 09:54:14,121::multipath::142::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving >MainThread::DEBUG::2014-09-09 09:54:14,121::hsm::418::Storage.Misc.excCmd::(__validateLvmLockingType) /usr/bin/sudo -n /usr/sbin/lvm dumpconfig global/locking_type (cwd None) >MainThread::DEBUG::2014-09-09 09:54:14,137::hsm::418::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2014-09-09 09:54:14,137::hsm::442::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2014-09-09 09:54:14,139::hsm::474::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2014-09-09 09:54:14,140::hsm::475::Storage.HSM::(__cleanStorageRepository) Mount list: ['/rhev/data-center/mnt/192.168.2.1:_home_storage_data', '/rhev/data-center/mnt/192.168.2.1:_home_storage_iso'] >MainThread::DEBUG::2014-09-09 09:54:14,140::hsm::477::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2014-09-09 09:54:14,140::hsm::520::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >storageRefresh::DEBUG::2014-09-09 09:54:14,141::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >storageRefresh::DEBUG::2014-09-09 09:54:14,141::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >MainThread::INFO::2014-09-09 09:54:14,142::dispatcher::46::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2014-09-09 09:54:14,142::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2014-09-09 09:54:14,174::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2014-09-09 09:54:14,174::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >storageRefresh::DEBUG::2014-09-09 09:54:14,175::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /usr/sbin/iscsiadm -m session -R (cwd None) >MainThread::DEBUG::2014-09-09 09:54:14,179::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f23e1e5-fec4-40a3-a657-4d0344e5a192`::moving from state init -> state preparing >MainThread::INFO::2014-09-09 09:54:14,182::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF object at 0x11fcf90>>) >MainThread::INFO::2014-09-09 09:54:14,182::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None >MainThread::DEBUG::2014-09-09 09:54:14,182::task::1191::Storage.TaskManager.Task::(prepare) Task=`6f23e1e5-fec4-40a3-a657-4d0344e5a192`::finished: None >MainThread::DEBUG::2014-09-09 09:54:14,182::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f23e1e5-fec4-40a3-a657-4d0344e5a192`::moving from state preparing -> state finished >MainThread::DEBUG::2014-09-09 09:54:14,182::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2014-09-09 09:54:14,182::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2014-09-09 09:54:14,182::task::993::Storage.TaskManager.Task::(_decref) Task=`6f23e1e5-fec4-40a3-a657-4d0344e5a192`::ref 0 aborting False >MainThread::INFO::2014-09-09 09:54:14,183::momIF::49::MOM::(__init__) Starting up MOM >MainThread::INFO::2014-09-09 09:54:14,185::vmchannels::192::vds::(settimeout) Setting channels' timeout to 30 seconds. >storageRefresh::DEBUG::2014-09-09 09:54:14,186::misc::751::Storage.SamplingMethod::(__call__) Returning last result >VM Channels Listener::INFO::2014-09-09 09:54:14,188::vmchannels::175::vds::(run) Starting VM channels listener thread. >clientIFinit::DEBUG::2014-09-09 09:54:14,188::libvirtconnection::150::root::(get) trying to connect libvirt >storageRefresh::DEBUG::2014-09-09 09:54:14,190::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /usr/sbin/multipath (cwd None) >MainThread::DEBUG::2014-09-09 09:54:14,196::protocoldetector::129::vds.MultiProtocolAcceptor::(add_detector) adding detector: <rpc.BindingXMLRPC.XmlDetector instance at 0x177ef80> >storageRefresh::DEBUG::2014-09-09 09:54:14,226::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-09-09 09:54:14,230::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-09-09 09:54:14,237::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-09-09 09:54:14,251::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-09-09 09:54:14,259::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >MainThread::DEBUG::2014-09-09 09:54:14,260::protocoldetector::129::vds.MultiProtocolAcceptor::(add_detector) adding detector: <yajsonrpc.stompReactor.StompDetector instance at 0x1904908> >storageRefresh::DEBUG::2014-09-09 09:54:14,260::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-09-09 09:54:14,260::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >JsonRpcServer::DEBUG::2014-09-09 09:54:14,261::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >storageRefresh::DEBUG::2014-09-09 09:54:14,261::misc::751::Storage.SamplingMethod::(__call__) Returning last result >storageRefresh::DEBUG::2014-09-09 09:54:14,262::lvm::317::Storage.OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Detector thread::DEBUG::2014-09-09 09:54:14,263::protocoldetector::68::vds.MultiProtocolAcceptor::(serve_forever) Acceptor running >Detector thread::DEBUG::2014-09-09 09:54:14,263::protocoldetector::70::vds.MultiProtocolAcceptor::(serve_forever) Using required_size=7 >storageRefresh::DEBUG::2014-09-09 09:54:14,336::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm pvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size (cwd None) >storageRefresh::DEBUG::2014-09-09 09:54:14,409::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n'; <rc> = 0 >storageRefresh::DEBUG::2014-09-09 09:54:14,409::lvm::342::Storage.OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-09-09 09:54:14,410::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-09-09 09:54:14,410::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None) >storageRefresh::DEBUG::2014-09-09 09:54:14,423::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-09-09 09:54:14,424::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-09-09 09:54:14,424::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm lvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags (cwd None) >storageRefresh::DEBUG::2014-09-09 09:54:14,436::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-09-09 09:54:14,436::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-09-09 09:54:14,437::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None) >storageRefresh::DEBUG::2014-09-09 09:54:14,449::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-09-09 09:54:14,449::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-09-09 09:54:14,449::hsm::387::Storage.HSM::(storageRefresh) HSM is ready >Detector thread::DEBUG::2014-09-09 09:54:20,133::protocoldetector::160::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 192.168.2.1:47213 >Detector thread::DEBUG::2014-09-09 09:54:20,135::protocoldetector::171::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 192.168.2.1:47213 >Detector thread::DEBUG::2014-09-09 09:54:20,135::protocoldetector::197::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 192.168.2.1:47213 >Detector thread::DEBUG::2014-09-09 09:54:20,135::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('192.168.2.1', 47213) >Thread-13::DEBUG::2014-09-09 09:54:20,136::BindingXMLRPC::1132::vds::(wrapper) client [192.168.2.1]::call getCapabilities with () {} >Thread-13::DEBUG::2014-09-09 09:54:20,152::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-13::DEBUG::2014-09-09 09:54:20,157::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-09 09:54:20,172::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/bonding_masters (cwd None) >Thread-13::DEBUG::2014-09-09 09:54:20,180::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-09 09:54:20,180::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/azRUijIX1gXbFt6/bonding/mode (cwd None) >Thread-13::DEBUG::2014-09-09 09:54:20,189::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-09 09:54:20,190::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/azRUijIX1gXbFt6/bonding/mode (cwd None) >Thread-13::DEBUG::2014-09-09 09:54:20,197::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-09 09:54:20,198::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/azRUijIX1gXbFt6/bonding/mode (cwd None) >Thread-13::DEBUG::2014-09-09 09:54:20,205::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-09 09:54:20,208::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/azRUijIX1gXbFt6/bonding/mode (cwd None) >Thread-13::DEBUG::2014-09-09 09:54:20,215::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-09 09:54:20,216::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/azRUijIX1gXbFt6/bonding/mode (cwd None) >Thread-13::DEBUG::2014-09-09 09:54:20,223::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-09 09:54:20,225::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/azRUijIX1gXbFt6/bonding/mode (cwd None) >Thread-13::DEBUG::2014-09-09 09:54:20,232::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-09 09:54:20,233::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/azRUijIX1gXbFt6/bonding/mode (cwd None) >Thread-13::DEBUG::2014-09-09 09:54:20,240::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-09 09:54:20,241::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/bonding_masters (cwd None) >Thread-13::DEBUG::2014-09-09 09:54:20,260::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-09 09:54:20,280::utils::738::root::(execCmd) numactl --hardware (cwd None) >Thread-13::DEBUG::2014-09-09 09:54:20,284::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-09 09:54:20,285::utils::738::root::(execCmd) sysctl -n -e kernel.numa_balancing (cwd None) >Thread-13::DEBUG::2014-09-09 09:54:20,288::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-09 09:54:20,303::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:df85635aad4d'}], 'FC': []}, 'packages2': {'kernel': {'release': '301.fc20.x86_64', 'buildtime': 1386270077.0, 'version': '3.11.10'}, 'spice-server': {'release': '2.fc20', 'buildtime': 1400513316L, 'version': '0.12.5'}, 'vdsm': {'release': '24.git16e82fe.fc20', 'buildtime': 1410269626L, 'version': '4.16.3'}, 'qemu-kvm': {'release': '1.fc20_rc3', 'buildtime': 1406666590L, 'version': '2.1.0'}, 'libvirt': {'release': '1.fc20', 'buildtime': 1407252230L, 'version': '1.2.8'}, 'qemu-img': {'release': '1.fc20_rc3', 'buildtime': 1406666590L, 'version': '2.1.0'}, 'mom': {'release': '1.fc20', 'buildtime': 1403118323L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz', 'liveMerge': 'true', 'hooks': {'before_vm_start': {'50_nestedvt': {'md5': '1eb86fc52cea5ee7812978176ce2d545'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '0'}, 'liveSnapshot': 'true', 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.2.100', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::fab1:56ff:fea8:7c34/64'], 'gateway': '192.168.2.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.2.100/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['em1']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.2.100', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::fab1:56ff:fea8:7c34/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.2.100/24'], 'ipv6gateway': '::', 'gateway': '192.168.2.1', 'opts': {'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '1000', 'group_fwd_mask': '0x0', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3125', 'hello_timer': '48', 'multicast_querier_interval': '25500', 'max_age': '2000', 'hash_max': '512', 'stp_state': '0', 'topology_change_detected': '0', 'priority': '32768', 'multicast_membership_interval': '26000', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', 'topology_change': '0', 'hello_time': '200', 'root_id': '8000.f8b156a87c34', 'bridge_id': '8000.f8b156a87c34', 'topology_change_timer': '0', 'ageing_time': '30000', 'nf_call_ip6tables': '0', 'gc_timer': '13166', 'nf_call_arptables': '0', 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', 'multicast_query_interval': '12500', 'multicast_query_use_ifaddr': '0', 'tcn_timer': '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': '0'}, 'ports': ['em1']}, 'virbr0': {'addr': '192.168.122.1', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'on', 'ipv4addrs': ['192.168.122.1/24'], 'ipv6gateway': '::', 'gateway': '', 'opts': {'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '1000', 'group_fwd_mask': '0x0', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3125', 'hello_timer': '150', 'multicast_querier_interval': '25500', 'max_age': '2000', 'hash_max': '512', 'stp_state': '1', 'topology_change_detected': '0', 'priority': '32768', 'multicast_membership_interval': '26000', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', 'topology_change': '0', 'hello_time': '200', 'root_id': '8000.000000000000', 'bridge_id': '8000.000000000000', 'topology_change_timer': '0', 'ageing_time': '30000', 'nf_call_ip6tables': '0', 'gc_timer': '7329', 'nf_call_arptables': '0', 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', 'multicast_query_interval': '12500', 'multicast_query_use_ifaddr': '0', 'tcn_timer': '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': '200'}, 'ports': []}}, 'uuid': '4C4C4544-0043-5210-8039-C4C04F425A31', 'lastClientIface': 'ovirtmgmt', 'nics': {'em1': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': 'f8:b1:56:a8:7c:34', 'DEVICE': 'em1', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': 'f8:b1:56:a8:7c:34', 'speed': 100}}, 'software_revision': '24', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,nopl,xtopology,nonstop_tsc,aperfmperf,eagerfpu,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,sse4_1,sse4_2,x2apic,popcnt,tsc_deadline_timer,aes,xsave,avx,f16c,rdrand,lahf_lm,ida,arat,epb,xsaveopt,pln,pts,dtherm,tpr_shadow,vnmi,flexpriority,ept,vpid,fsgsbase,smep,erms,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:df85635aad4d', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '5e:94:b4:d2:15:37', 'slaves': [], 'opts': {}}}, 'software_version': '4.16', 'memSize': '15937', 'cpuSpeed': '1598.000', 'numaNodes': {u'0': {'totalMemory': '15937', 'cpus': [0, 1, 2, 3, 4, 5, 6, 7]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '8', 'emulatedMachines': [u'pc', u'pc-1.3', u'pc-0.12', u'pc-q35-1.6', u'pc-q35-1.5', u'xenpv', u'pc-i440fx-1.6', u'pc-i440fx-1.7', u'q35', u'pc-0.11', u'pc-0.10', u'pc-1.2', u'isapc', u'pc-q35-1.4', u'xenfv', u'pc-0.15', u'pc-i440fx-1.5', u'pc-i440fx-1.4', u'pc-q35-2.0', u'pc-0.14', u'pc-1.1', u'pc-q35-1.7', u'pc-1.0', u'pc-i440fx-2.0', u'pc-0.13'], 'rngSources': ['random'], 'operatingSystem': {'release': '3', 'version': '20', 'name': 'Fedora'}, 'lastClient': '192.168.2.1'}} >Thread-13::DEBUG::2014-09-09 09:54:20,330::BindingXMLRPC::1132::vds::(wrapper) client [192.168.2.1]::call getHardwareInfo with () {} >Thread-13::DEBUG::2014-09-09 09:54:20,350::BindingXMLRPC::1139::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'OptiPlex 7010', 'systemUUID': '4C4C4544-0043-5210-8039-C4C04F425A31', 'systemSerialNumber': 'DCR9BZ1', 'systemVersion': '01', 'systemManufacturer': 'Dell Inc.'}} >Thread-13::DEBUG::2014-09-09 09:54:20,409::BindingXMLRPC::1132::vds::(wrapper) client [192.168.2.1]::call getCapabilities with () {} flowID [310c08c7] >Thread-13::DEBUG::2014-09-09 09:54:20,410::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-13::DEBUG::2014-09-09 09:54:20,414::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-09 09:54:20,427::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:df85635aad4d'}], 'FC': []}, 'packages2': {'kernel': {'release': '301.fc20.x86_64', 'buildtime': 1386270077.0, 'version': '3.11.10'}, 'spice-server': {'release': '2.fc20', 'buildtime': 1400513316L, 'version': '0.12.5'}, 'vdsm': {'release': '24.git16e82fe.fc20', 'buildtime': 1410269626L, 'version': '4.16.3'}, 'qemu-kvm': {'release': '1.fc20_rc3', 'buildtime': 1406666590L, 'version': '2.1.0'}, 'libvirt': {'release': '1.fc20', 'buildtime': 1407252230L, 'version': '1.2.8'}, 'qemu-img': {'release': '1.fc20_rc3', 'buildtime': 1406666590L, 'version': '2.1.0'}, 'mom': {'release': '1.fc20', 'buildtime': 1403118323L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz', 'liveMerge': 'true', 'hooks': {'before_vm_start': {'50_nestedvt': {'md5': '1eb86fc52cea5ee7812978176ce2d545'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '0'}, 'liveSnapshot': 'true', 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.2.100', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::fab1:56ff:fea8:7c34/64'], 'gateway': '192.168.2.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.2.100/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['em1']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.2.100', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::fab1:56ff:fea8:7c34/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.2.100/24'], 'ipv6gateway': '::', 'gateway': '192.168.2.1', 'opts': {'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '1000', 'group_fwd_mask': '0x0', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3125', 'hello_timer': '32', 'multicast_querier_interval': '25500', 'max_age': '2000', 'hash_max': '512', 'stp_state': '0', 'topology_change_detected': '0', 'priority': '32768', 'multicast_membership_interval': '26000', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', 'topology_change': '0', 'hello_time': '200', 'root_id': '8000.f8b156a87c34', 'bridge_id': '8000.f8b156a87c34', 'topology_change_timer': '0', 'ageing_time': '30000', 'nf_call_ip6tables': '0', 'gc_timer': '13150', 'nf_call_arptables': '0', 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', 'multicast_query_interval': '12500', 'multicast_query_use_ifaddr': '0', 'tcn_timer': '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': '0'}, 'ports': ['em1']}, 'virbr0': {'addr': '192.168.122.1', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'on', 'ipv4addrs': ['192.168.122.1/24'], 'ipv6gateway': '::', 'gateway': '', 'opts': {'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '1000', 'group_fwd_mask': '0x0', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3125', 'hello_timer': '134', 'multicast_querier_interval': '25500', 'max_age': '2000', 'hash_max': '512', 'stp_state': '1', 'topology_change_detected': '0', 'priority': '32768', 'multicast_membership_interval': '26000', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', 'topology_change': '0', 'hello_time': '200', 'root_id': '8000.000000000000', 'bridge_id': '8000.000000000000', 'topology_change_timer': '0', 'ageing_time': '30000', 'nf_call_ip6tables': '0', 'gc_timer': '7313', 'nf_call_arptables': '0', 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', 'multicast_query_interval': '12500', 'multicast_query_use_ifaddr': '0', 'tcn_timer': '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': '200'}, 'ports': []}}, 'uuid': '4C4C4544-0043-5210-8039-C4C04F425A31', 'lastClientIface': 'ovirtmgmt', 'nics': {'em1': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': 'f8:b1:56:a8:7c:34', 'DEVICE': 'em1', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': 'f8:b1:56:a8:7c:34', 'speed': 100}}, 'software_revision': '24', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,nopl,xtopology,nonstop_tsc,aperfmperf,eagerfpu,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,sse4_1,sse4_2,x2apic,popcnt,tsc_deadline_timer,aes,xsave,avx,f16c,rdrand,lahf_lm,ida,arat,epb,xsaveopt,pln,pts,dtherm,tpr_shadow,vnmi,flexpriority,ept,vpid,fsgsbase,smep,erms,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:df85635aad4d', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '5e:94:b4:d2:15:37', 'slaves': [], 'opts': {}}}, 'software_version': '4.16', 'memSize': '15937', 'cpuSpeed': '2754.000', 'numaNodes': {u'0': {'totalMemory': '15937', 'cpus': [0, 1, 2, 3, 4, 5, 6, 7]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '8', 'emulatedMachines': [u'pc', u'pc-1.3', u'pc-0.12', u'pc-q35-1.6', u'pc-q35-1.5', u'xenpv', u'pc-i440fx-1.6', u'pc-i440fx-1.7', u'q35', u'pc-0.11', u'pc-0.10', u'pc-1.2', u'isapc', u'pc-q35-1.4', u'xenfv', u'pc-0.15', u'pc-i440fx-1.5', u'pc-i440fx-1.4', u'pc-q35-2.0', u'pc-0.14', u'pc-1.1', u'pc-q35-1.7', u'pc-1.0', u'pc-i440fx-2.0', u'pc-0.13'], 'rngSources': ['random'], 'operatingSystem': {'release': '3', 'version': '20', 'name': 'Fedora'}, 'lastClient': '192.168.2.1'}} >Thread-13::DEBUG::2014-09-09 09:54:20,443::BindingXMLRPC::1132::vds::(wrapper) client [192.168.2.1]::call getHardwareInfo with () {} flowID [310c08c7] >Thread-13::DEBUG::2014-09-09 09:54:20,444::BindingXMLRPC::1139::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'OptiPlex 7010', 'systemUUID': '4C4C4544-0043-5210-8039-C4C04F425A31', 'systemSerialNumber': 'DCR9BZ1', 'systemVersion': '01', 'systemManufacturer': 'Dell Inc.'}} >Thread-13::DEBUG::2014-09-09 09:54:20,510::BindingXMLRPC::318::vds::(wrapper) client [192.168.2.1] flowID [557b1013] >Thread-13::DEBUG::2014-09-09 09:54:20,510::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ed6c82d-0829-433c-b9fe-793758b18359`::moving from state init -> state preparing >Thread-13::INFO::2014-09-09 09:54:20,511::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='5745e11d-81b4-4d82-8fed-c8a22ec23383', conList=[{'connection': '192.168.2.1:/home/storage/iso', 'iqn': '', 'user': '', 'tpgt': '1', 'password': '******', 'id': '627a78ed-6123-4e11-a839-63b100459bc3', 'port': ''}, {'connection': '192.168.2.1:/home/storage/data', 'iqn': '', 'user': '', 'tpgt': '1', 'password': '******', 'id': 'b2429c9b-0750-46f1-a95a-ec0448e6435d', 'port': ''}], options=None) >Thread-13::DEBUG::2014-09-09 09:54:20,512::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.2.1:_home_storage_iso >Thread-13::DEBUG::2014-09-09 09:54:20,512::__init__::157::IOProcessClient::(_run) Starting IOProcess... >Thread-14::INFO::2014-09-09 09:54:20,516::__init__::227::IOProcess::(_processLogs) Starting ioprocess >Thread-14::DEBUG::2014-09-09 09:54:20,516::__init__::225::IOProcess::(_processLogs) Closing unrelated FDs... >Thread-14::DEBUG::2014-09-09 09:54:20,516::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 0 (pipe:[6889707]) >Thread-14::DEBUG::2014-09-09 09:54:20,517::__init__::225::IOProcess::(_processLogs) Not closing FD 1 because it's in whitelist >Thread-14::DEBUG::2014-09-09 09:54:20,517::__init__::225::IOProcess::(_processLogs) Not closing FD 2 because it's in whitelist >Thread-14::DEBUG::2014-09-09 09:54:20,517::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 3 (socket:[6887727]) >Thread-14::DEBUG::2014-09-09 09:54:20,517::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 4 (/var/log/vdsm/vdsm.log) >Thread-14::DEBUG::2014-09-09 09:54:20,517::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 5 (/var/log/vdsm/connectivity.log) >Thread-14::DEBUG::2014-09-09 09:54:20,517::__init__::225::IOProcess::(_processLogs) Not closing FD 6 because it's the directory fd >Thread-14::DEBUG::2014-09-09 09:54:20,517::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 9 (/proc/meminfo/connectivity.log) >Thread-14::DEBUG::2014-09-09 09:54:20,517::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 10 (socket:[6883110]nnectivity.log) >Thread-14::DEBUG::2014-09-09 09:54:20,517::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 12 (/proc/vmstat110]nnectivity.log) >Thread-14::DEBUG::2014-09-09 09:54:20,517::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 13 (anon_inode:[eventpoll]vity.log) >Thread-14::DEBUG::2014-09-09 09:54:20,517::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 15 (/var/log/vdsm/mom.log]vity.log) >Thread-14::DEBUG::2014-09-09 09:54:20,517::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 16 (/sys/kernel/mm/ksm/pages_sharing) >Thread-14::DEBUG::2014-09-09 09:54:20,518::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 18 (/sys/kernel/mm/ksm/pages_unshared) >Thread-14::DEBUG::2014-09-09 09:54:20,518::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 19 (/sys/kernel/mm/ksm/full_scansared) >Thread-14::DEBUG::2014-09-09 09:54:20,518::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 20 (/sys/kernel/mm/ksm/runl_scansared) >Thread-14::DEBUG::2014-09-09 09:54:20,518::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 21 (/sys/kernel/mm/ksm/pages_shareded) >Thread-14::DEBUG::2014-09-09 09:54:20,518::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 22 (/sys/kernel/mm/ksm/pages_to_scand) >Thread-14::DEBUG::2014-09-09 09:54:20,518::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 23 (/sys/kernel/mm/ksm/pages_volatile) >Thread-14::DEBUG::2014-09-09 09:54:20,518::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 24 (/sys/kernel/mm/ksm/sleep_millisecs) >Thread-14::DEBUG::2014-09-09 09:54:20,518::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 25 (socket:[6889574]sm/sleep_millisecs) >Thread-14::DEBUG::2014-09-09 09:54:20,518::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 26 (pipe:[6889704]4]sm/sleep_millisecs) >Thread-14::DEBUG::2014-09-09 09:54:20,518::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 27 (/proc/cpuinfo]4]sm/sleep_millisecs) >Thread-14::DEBUG::2014-09-09 09:54:20,518::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 33 (socket:[6883119]sm/sleep_millisecs) >Thread-14::DEBUG::2014-09-09 09:54:20,518::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 34 (pipe:[6888509]9]sm/sleep_millisecs) >Thread-14::DEBUG::2014-09-09 09:54:20,518::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 35 (pipe:[6888509]9]sm/sleep_millisecs) >Thread-14::DEBUG::2014-09-09 09:54:20,519::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 36 (socket:[6889687]sm/sleep_millisecs) >Thread-14::DEBUG::2014-09-09 09:54:20,519::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 37 (pipe:[6889704]7]sm/sleep_millisecs) >Thread-14::DEBUG::2014-09-09 09:54:20,519::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 38 (pipe:[6889705]7]sm/sleep_millisecs) >Thread-14::DEBUG::2014-09-09 09:54:20,519::__init__::225::IOProcess::(_processLogs) Not closing FD 39 because it's in whitelist >Thread-14::DEBUG::2014-09-09 09:54:20,519::__init__::225::IOProcess::(_processLogs) Not closing FD 40 because it's in whitelist >Thread-14::DEBUG::2014-09-09 09:54:20,519::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 41 (pipe:[6889706]7]sm/sleep_millisecs) >Thread-14::DEBUG::2014-09-09 09:54:20,519::__init__::225::IOProcess::(_processLogs) Opening communication channels... >Thread-14::DEBUG::2014-09-09 09:54:20,519::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:20,519::__init__::225::IOProcess::(_processLogs) Not closing FD 40 because iDEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:20,519::__init__::225::IOProcess::(_processLogs) Message size is 144 >Thread-14::DEBUG::2014-09-09 09:54:20,519::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:20,520::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:20,520::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:20,520::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:20,520::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:20,520::__init__::225::IOProcess::(_processLogs) (1) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-09 09:54:20,520::__init__::225::IOProcess::(_processLogs) (1) Got request for method 'glob' >Thread-14::DEBUG::2014-09-09 09:54:20,522::__init__::225::IOProcess::(_processLogs) Not closing FD 40 because iDEBUG|(1) Building response >Thread-14::DEBUG::2014-09-09 09:54:20,522::__init__::225::IOProcess::(_processLogs) Not closing FD 40 because iDEBUG|(1) Queuing response >Thread-13::DEBUG::2014-09-09 09:54:20,522::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'e453999e-ec9f-420b-941c-a9f9cc4432bb',) >Thread-13::DEBUG::2014-09-09 09:54:20,523::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {e453999e-ec9f-420b-941c-a9f9cc4432bb: storage.nfsSD.findDomain} >Thread-14::DEBUG::2014-09-09 09:54:20,523::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:20,524::__init__::225::IOProcess::(_processLogs) Sending response sized 141 >Thread-13::DEBUG::2014-09-09 09:54:20,525::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.2.1:_home_storage_data >Thread-14::DEBUG::2014-09-09 09:54:20,525::__init__::225::IOProcess::(_processLogs) Not closing FD 40 because iDEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:20,525::__init__::225::IOProcess::(_processLogs) Message size is 145 >Thread-14::DEBUG::2014-09-09 09:54:20,525::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:20,526::__init__::225::IOProcess::(_processLogs) Not closing FD 40 because iDEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:20,526::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:20,526::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:20,526::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:20,526::__init__::225::IOProcess::(_processLogs) (2) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-09 09:54:20,526::__init__::225::IOProcess::(_processLogs) (2) Got request for method 'glob' >Thread-14::DEBUG::2014-09-09 09:54:20,528::__init__::225::IOProcess::(_processLogs) Not closing FD 40 because iDEBUG|(2) Building response >Thread-13::DEBUG::2014-09-09 09:54:20,529::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'caf02237-e8a4-49fe-ab6d-4d23843f0edf',) >Thread-14::DEBUG::2014-09-09 09:54:20,529::__init__::225::IOProcess::(_processLogs) (2) Queuing response >Thread-13::DEBUG::2014-09-09 09:54:20,529::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {e453999e-ec9f-420b-941c-a9f9cc4432bb: storage.nfsSD.findDomain, caf02237-e8a4-49fe-ab6d-4d23843f0edf: storage.nfsSD.findDomain} >Thread-14::DEBUG::2014-09-09 09:54:20,529::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-13::INFO::2014-09-09 09:54:20,530::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '627a78ed-6123-4e11-a839-63b100459bc3'}, {'status': 0, 'id': 'b2429c9b-0750-46f1-a95a-ec0448e6435d'}]} >Thread-14::DEBUG::2014-09-09 09:54:20,530::__init__::225::IOProcess::(_processLogs) Sending response sized 142 >Thread-13::DEBUG::2014-09-09 09:54:20,530::task::1191::Storage.TaskManager.Task::(prepare) Task=`9ed6c82d-0829-433c-b9fe-793758b18359`::finished: {'statuslist': [{'status': 0, 'id': '627a78ed-6123-4e11-a839-63b100459bc3'}, {'status': 0, 'id': 'b2429c9b-0750-46f1-a95a-ec0448e6435d'}]} >Thread-13::DEBUG::2014-09-09 09:54:20,531::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ed6c82d-0829-433c-b9fe-793758b18359`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-09-09 09:54:20,531::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-09-09 09:54:20,531::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-09-09 09:54:20,531::task::993::Storage.TaskManager.Task::(_decref) Task=`9ed6c82d-0829-433c-b9fe-793758b18359`::ref 0 aborting False >Thread-13::DEBUG::2014-09-09 09:54:20,544::BindingXMLRPC::318::vds::(wrapper) client [192.168.2.1] >Thread-13::DEBUG::2014-09-09 09:54:20,544::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e9ae6af-3492-4574-bdf0-b8ca37f38042`::moving from state init -> state preparing >Thread-13::INFO::2014-09-09 09:54:20,544::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='5745e11d-81b4-4d82-8fed-c8a22ec23383', hostID=2, msdUUID='caf02237-e8a4-49fe-ab6d-4d23843f0edf', masterVersion=1, domainsMap={'e453999e-ec9f-420b-941c-a9f9cc4432bb': 'active', 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': 'active'}, options=None) >Thread-13::DEBUG::2014-09-09 09:54:20,545::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`8b6f62b5-24a7-4ba7-a980-6f7509e3aee1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1011' at 'connectStoragePool' >Thread-13::DEBUG::2014-09-09 09:54:20,545::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-13::DEBUG::2014-09-09 09:54:20,545::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-13::DEBUG::2014-09-09 09:54:20,545::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`8b6f62b5-24a7-4ba7-a980-6f7509e3aee1`::Granted request >Thread-13::DEBUG::2014-09-09 09:54:20,545::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`4b3d16fa-6025-4172-861d-315f6cf1b5e1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1059' at '_connectStoragePool' >Thread-13::DEBUG::2014-09-09 09:54:20,545::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'exclusive' >Thread-13::DEBUG::2014-09-09 09:54:20,545::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'exclusive' (1 active user) >Thread-13::DEBUG::2014-09-09 09:54:20,546::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`4b3d16fa-6025-4172-861d-315f6cf1b5e1`::Granted request >Thread-13::DEBUG::2014-09-09 09:54:20,546::spbackends::485::Storage.StoragePoolMemoryBackend::(updateVersionAndDomains) updating domain version to 1 and domains map to {'e453999e-ec9f-420b-941c-a9f9cc4432bb': 'active', 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': 'active'} >Thread-13::INFO::2014-09-09 09:54:20,546::spbackends::433::Storage.StoragePoolMemoryBackend::(setDomainsMap) new storage pool master version 1 and domains map {'e453999e-ec9f-420b-941c-a9f9cc4432bb': 'Active', 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': 'Active'} >Thread-13::INFO::2014-09-09 09:54:20,546::sp::133::Storage.StoragePool::(setBackend) updating pool 5745e11d-81b4-4d82-8fed-c8a22ec23383 backend from type NoneType instance 0x36c478ff00 to type StoragePoolMemoryBackend instance 0x7f41680fae68 >Thread-13::INFO::2014-09-09 09:54:20,546::sp::631::Storage.StoragePool::(connect) Connect host #2 to the storage pool 5745e11d-81b4-4d82-8fed-c8a22ec23383 with master domain: caf02237-e8a4-49fe-ab6d-4d23843f0edf (ver = 1) >Thread-13::DEBUG::2014-09-09 09:54:20,546::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-09-09 09:54:20,546::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-09-09 09:54:20,546::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-09-09 09:54:20,546::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-09-09 09:54:20,547::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-09-09 09:54:20,547::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-09-09 09:54:20,547::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-13::DEBUG::2014-09-09 09:54:20,547::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-13::DEBUG::2014-09-09 09:54:20,547::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-13::DEBUG::2014-09-09 09:54:20,547::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-13::DEBUG::2014-09-09 09:54:20,547::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-13::DEBUG::2014-09-09 09:54:20,547::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /usr/sbin/iscsiadm -m session -R (cwd None) >Thread-13::DEBUG::2014-09-09 09:54:20,555::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-13::DEBUG::2014-09-09 09:54:20,555::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /usr/sbin/multipath (cwd None) >Thread-13::DEBUG::2014-09-09 09:54:20,570::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-09 09:54:20,570::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-09-09 09:54:20,570::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-09-09 09:54:20,571::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-09-09 09:54:20,571::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-09-09 09:54:20,571::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-09-09 09:54:20,571::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-09-09 09:54:20,571::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-14::DEBUG::2014-09-09 09:54:20,572::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:20,573::__init__::225::IOProcess::(_processLogs) Message size is 125 >Thread-14::DEBUG::2014-09-09 09:54:20,573::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:20,573::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:20,573::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:20,573::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:20,573::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:20,573::__init__::225::IOProcess::(_processLogs) (3) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-09 09:54:20,573::__init__::225::IOProcess::(_processLogs) (3) Got request for method 'glob' >Thread-14::DEBUG::2014-09-09 09:54:20,573::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:20,574::__init__::225::IOProcess::(_processLogs) Message size is 124 >Thread-14::DEBUG::2014-09-09 09:54:20,574::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:20,574::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:20,574::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:20,574::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:20,574::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:20,574::__init__::225::IOProcess::(_processLogs) (4) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-09 09:54:20,574::__init__::225::IOProcess::(_processLogs) (4) Got request for method 'glob' >Thread-14::DEBUG::2014-09-09 09:54:20,574::__init__::225::IOProcess::(_processLogs) DEBUG|(3) Building response >Thread-14::DEBUG::2014-09-09 09:54:20,575::__init__::225::IOProcess::(_processLogs) (3) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:20,575::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:20,576::__init__::225::IOProcess::(_processLogs) Sending response sized 149 >Thread-14::DEBUG::2014-09-09 09:54:20,577::__init__::225::IOProcess::(_processLogs) (3) Queuing responseDEBUG|(4) Building response >Thread-14::DEBUG::2014-09-09 09:54:20,578::__init__::225::IOProcess::(_processLogs) (4) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:20,579::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:20,579::__init__::225::IOProcess::(_processLogs) Sending response sized 148 >Thread-13::DEBUG::2014-09-09 09:54:20,580::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-14::DEBUG::2014-09-09 09:54:20,580::__init__::225::IOProcess::(_processLogs) (3) Queuing responseDEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:20,580::__init__::225::IOProcess::(_processLogs) Message size is 154 >Thread-14::DEBUG::2014-09-09 09:54:20,580::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:20,581::__init__::225::IOProcess::(_processLogs) (3) Queuing responseDEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:20,581::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:20,581::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:20,581::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:20,581::__init__::225::IOProcess::(_processLogs) (5) Finding callback 'touch'... >Thread-14::DEBUG::2014-09-09 09:54:20,581::__init__::225::IOProcess::(_processLogs) (5) Got request for method 'touch' >Thread-14::DEBUG::2014-09-09 09:54:20,786::__init__::225::IOProcess::(_processLogs) (3) Queuing responseDEBUG|(5) Building response >Thread-14::DEBUG::2014-09-09 09:54:20,786::__init__::225::IOProcess::(_processLogs) (5) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:20,786::__init__::225::IOProcess::(_processLogs) (3) Queuing responseDEBUG|Generating json... >Thread-13::DEBUG::2014-09-09 09:54:20,786::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-14::DEBUG::2014-09-09 09:54:20,787::__init__::225::IOProcess::(_processLogs) Sending response sized 53 >Thread-14::DEBUG::2014-09-09 09:54:20,787::__init__::225::IOProcess::(_processLogs) (3) Queuing responseDEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:20,787::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-14::DEBUG::2014-09-09 09:54:20,788::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:20,788::__init__::225::IOProcess::(_processLogs) (3) Queuing responseDEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:20,788::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:20,788::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:20,788::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:20,788::__init__::225::IOProcess::(_processLogs) (6) Finding callback 'readfile'... >Thread-14::DEBUG::2014-09-09 09:54:20,788::__init__::225::IOProcess::(_processLogs) (6) Got request for method 'readfile' >Thread-14::DEBUG::2014-09-09 09:54:20,791::__init__::225::IOProcess::(_processLogs) (3) Queuing responseDEBUG|(6) Building response >Thread-14::DEBUG::2014-09-09 09:54:20,791::__init__::225::IOProcess::(_processLogs) (6) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:20,792::__init__::225::IOProcess::(_processLogs) (3) Queuing responseDEBUG|Generating json... >Thread-13::DEBUG::2014-09-09 09:54:20,792::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfs', 'POOL_DOMAINS=e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data', 'ROLE=Master', 'SDUUID=caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=0b5682af506c2f8194f0e48e2f45adc239d2e2eb'] >Thread-14::DEBUG::2014-09-09 09:54:20,792::__init__::225::IOProcess::(_processLogs) Sending response sized 723 >Thread-14::DEBUG::2014-09-09 09:54:20,793::__init__::225::IOProcess::(_processLogs) (3) Queuing responseDEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:20,793::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-14::DEBUG::2014-09-09 09:54:20,793::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:20,794::__init__::225::IOProcess::(_processLogs) (3) Queuing responseDEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:20,794::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:20,794::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:20,794::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:20,794::__init__::225::IOProcess::(_processLogs) (7) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:54:20,794::__init__::225::IOProcess::(_processLogs) (7) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:54:20,794::__init__::225::IOProcess::(_processLogs) (7) Building response >Thread-14::DEBUG::2014-09-09 09:54:20,794::__init__::225::IOProcess::(_processLogs) (7) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:20,794::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:20,794::__init__::225::IOProcess::(_processLogs) Sending response sized 53 >Thread-14::DEBUG::2014-09-09 09:54:20,795::__init__::225::IOProcess::(_processLogs) (3) Queuing responseDEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:20,795::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-14::DEBUG::2014-09-09 09:54:20,795::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:20,795::__init__::225::IOProcess::(_processLogs) (3) Queuing responseDEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:20,795::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:20,795::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:20,795::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:20,795::__init__::225::IOProcess::(_processLogs) (8) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-09 09:54:20,795::__init__::225::IOProcess::(_processLogs) (8) Got request for method 'glob' >Thread-14::DEBUG::2014-09-09 09:54:20,797::__init__::225::IOProcess::(_processLogs) (3) Queuing responseDEBUG|(8) Building response >Thread-14::DEBUG::2014-09-09 09:54:20,797::__init__::225::IOProcess::(_processLogs) (8) Queuing response >Thread-13::DEBUG::2014-09-09 09:54:20,797::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-14::DEBUG::2014-09-09 09:54:20,797::__init__::225::IOProcess::(_processLogs) (3) Queuing responseDEBUG|Generating json... >Thread-14::DEBUG::2014-09-09 09:54:20,798::__init__::225::IOProcess::(_processLogs) Sending response sized 51 >Thread-13::DEBUG::2014-09-09 09:54:20,798::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS' >Thread-13::DEBUG::2014-09-09 09:54:20,799::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS' >Thread-13::DEBUG::2014-09-09 09:54:20,799::sp::1390::Storage.StoragePool::(setMasterDomain) Master domain caf02237-e8a4-49fe-ab6d-4d23843f0edf verified, version 1 >Thread-13::DEBUG::2014-09-09 09:54:20,799::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-13::DEBUG::2014-09-09 09:54:20,799::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-13::INFO::2014-09-09 09:54:20,799::domainMonitor::100::Storage.DomainMonitor::(startMonitoring) Start monitoring e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-17::DEBUG::2014-09-09 09:54:20,799::domainMonitor::182::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-13::DEBUG::2014-09-09 09:54:20,799::sp::1413::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `5745e11d-81b4-4d82-8fed-c8a22ec23383` started monitoring domain `e453999e-ec9f-420b-941c-a9f9cc4432bb` >Thread-13::INFO::2014-09-09 09:54:20,800::domainMonitor::100::Storage.DomainMonitor::(startMonitoring) Start monitoring caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-13::DEBUG::2014-09-09 09:54:20,802::sp::1413::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `5745e11d-81b4-4d82-8fed-c8a22ec23383` started monitoring domain `caf02237-e8a4-49fe-ab6d-4d23843f0edf` >Thread-19::DEBUG::2014-09-09 09:54:20,802::domainMonitor::182::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-14::DEBUG::2014-09-09 09:54:20,802::__init__::225::IOProcess::(_processLogs) (3) Queuing responseDEBUG|Receiving request... >Thread-13::DEBUG::2014-09-09 09:54:20,803::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-13::DEBUG::2014-09-09 09:54:20,803::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383 >Thread-14::DEBUG::2014-09-09 09:54:20,804::__init__::225::IOProcess::(_processLogs) Message size is 125 >Thread-14::DEBUG::2014-09-09 09:54:20,804::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:20,804::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:20,805::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:20,806::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:20,806::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-13::DEBUG::2014-09-09 09:54:20,806::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-09-09 09:54:20,807::__init__::225::IOProcess::(_processLogs) (9) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-09 09:54:20,807::__init__::225::IOProcess::(_processLogs) (9) Got request for method 'glob' >Thread-14::DEBUG::2014-09-09 09:54:20,808::__init__::225::IOProcess::(_processLogs) (3) Queuing responseDEBUG|(9) Building response >Thread-13::DEBUG::2014-09-09 09:54:20,809::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e453999e-ec9f-420b-941c-a9f9cc4432bb (cwd None) >Thread-14::DEBUG::2014-09-09 09:54:20,809::__init__::225::IOProcess::(_processLogs) (9) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:20,813::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:20,813::__init__::225::IOProcess::(_processLogs) Sending response sized 149 >Thread-14::DEBUG::2014-09-09 09:54:20,814::__init__::225::IOProcess::(_processLogs) (3) Queuing responseDEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:20,814::__init__::225::IOProcess::(_processLogs) Message size is 125 >Thread-14::DEBUG::2014-09-09 09:54:20,814::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:20,814::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:20,814::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:20,814::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:20,814::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:20,815::__init__::225::IOProcess::(_processLogs) (10) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-09 09:54:20,815::__init__::225::IOProcess::(_processLogs) (10) Got request for method 'glob' >Thread-14::DEBUG::2014-09-09 09:54:20,815::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:20,815::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-09 09:54:20,816::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:20,817::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:20,818::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:20,819::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:20,820::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:20,820::__init__::225::IOProcess::(_processLogs) (11) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:54:20,821::__init__::225::IOProcess::(_processLogs) (11) Got request for method 'statvfs' >Thread-17::DEBUG::2014-09-09 09:54:20,821::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-14::DEBUG::2014-09-09 09:54:20,822::__init__::225::IOProcess::(_processLogs) (10) Building response >Thread-14::DEBUG::2014-09-09 09:54:20,822::__init__::225::IOProcess::(_processLogs) (10) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:20,822::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:20,822::__init__::225::IOProcess::(_processLogs) Sending response sized 149 >Thread-14::DEBUG::2014-09-09 09:54:20,823::__init__::225::IOProcess::(_processLogs) (11) Building response >Thread-14::DEBUG::2014-09-09 09:54:20,823::__init__::225::IOProcess::(_processLogs) (11) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:20,823::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:20,823::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-14::DEBUG::2014-09-09 09:54:20,824::__init__::225::IOProcess::(_processLogs) Message size is 146DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 09:54:20,824::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-09 09:54:20,824::__init__::225::IOProcess::(_processLogs) Message size is 154 >Thread-13::DEBUG::2014-09-09 09:54:20,828::lvm::288::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n Volume group "e453999e-ec9f-420b-941c-a9f9cc4432bb" not found\n Skipping volume group e453999e-ec9f-420b-941c-a9f9cc4432bb\n'; <rc> = 5 >Thread-14::DEBUG::2014-09-09 09:54:20,829::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:20,830::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-13::WARNING::2014-09-09 09:54:20,830::lvm::370::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!', ' Volume group "e453999e-ec9f-420b-941c-a9f9cc4432bb" not found', ' Skipping volume group e453999e-ec9f-420b-941c-a9f9cc4432bb'] >Thread-14::DEBUG::2014-09-09 09:54:20,831::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 09:54:20,831::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n504 bytes (504 B) copied, 0.000920667 s, 547 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-09 09:54:20,832::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-13::DEBUG::2014-09-09 09:54:20,832::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-09-09 09:54:20,833::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:20,833::__init__::225::IOProcess::(_processLogs) (12) Finding callback 'touch'... >Thread-14::DEBUG::2014-09-09 09:54:20,834::__init__::225::IOProcess::(_processLogs) (12) Got request for method 'touch' >Thread-14::DEBUG::2014-09-09 09:54:20,835::__init__::225::IOProcess::(_processLogs) Message size is 146DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:20,835::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-09 09:54:20,835::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:20,835::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:20,835::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:20,835::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:20,835::__init__::225::IOProcess::(_processLogs) Message size is 146DEBUG|DEBUG|Queuing request in the thread pool...Message size is 126 >Thread-14::DEBUG::2014-09-09 09:54:20,836::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:20,836::__init__::225::IOProcess::(_processLogs) (13) Finding callback 'statvfs'...DEBUGDEBUG| >Thread-14::DEBUG::2014-09-09 09:54:20,836::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:20,836::__init__::225::IOProcess::(_processLogs) (14) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-09 09:54:20,836::__init__::225::IOProcess::(_processLogs) (14) Got request for method 'glob' >Thread-14::DEBUG::2014-09-09 09:54:20,836::__init__::225::IOProcess::(_processLogs) Message size is 146DEBUG|(14) Building response >Thread-14::DEBUG::2014-09-09 09:54:20,837::__init__::225::IOProcess::(_processLogs) (12) Building response >Thread-14::DEBUG::2014-09-09 09:54:20,837::__init__::225::IOProcess::(_processLogs) (14) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:20,837::__init__::225::IOProcess::(_processLogs) (12) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:20,837::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:20,837::__init__::225::IOProcess::(_processLogs) (13) Building response >Thread-14::DEBUG::2014-09-09 09:54:20,837::__init__::225::IOProcess::(_processLogs) Sending response sized 150 >Thread-14::DEBUG::2014-09-09 09:54:20,837::__init__::225::IOProcess::(_processLogs) (13) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:20,837::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:20,837::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-14::DEBUG::2014-09-09 09:54:20,837::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:20,837::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-14::DEBUG::2014-09-09 09:54:20,837::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:20,838::__init__::225::IOProcess::(_processLogs) Message size is 125 >Thread-14::DEBUG::2014-09-09 09:54:20,838::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:20,838::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:20,838::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:20,838::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:20,838::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:20,838::__init__::225::IOProcess::(_processLogs) (15) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-09 09:54:20,838::__init__::225::IOProcess::(_processLogs) (15) Got request for method 'glob' >Thread-14::DEBUG::2014-09-09 09:54:20,838::__init__::225::IOProcess::(_processLogs) Message size is 146DEBUG|(15) Building response >Thread-17::DEBUG::2014-09-09 09:54:20,838::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-14::DEBUG::2014-09-09 09:54:20,839::__init__::225::IOProcess::(_processLogs) (15) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:20,839::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:20,839::__init__::225::IOProcess::(_processLogs) Sending response sized 149 >Thread-14::DEBUG::2014-09-09 09:54:20,840::__init__::225::IOProcess::(_processLogs) Message size is 146DEBUG|Receiving request... >Thread-13::INFO::2014-09-09 09:54:20,841::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb to /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-14::DEBUG::2014-09-09 09:54:20,841::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-14::DEBUG::2014-09-09 09:54:20,841::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-13::DEBUG::2014-09-09 09:54:20,841::sp::1137::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb to /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-14::DEBUG::2014-09-09 09:54:20,842::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-13::INFO::2014-09-09 09:54:20,842::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf to /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-14::DEBUG::2014-09-09 09:54:20,842::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-13::DEBUG::2014-09-09 09:54:20,843::sp::1137::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf to /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-14::DEBUG::2014-09-09 09:54:20,843::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-13::INFO::2014-09-09 09:54:20,843::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf to /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd >Thread-14::DEBUG::2014-09-09 09:54:20,844::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-13::DEBUG::2014-09-09 09:54:20,844::sp::1137::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf to /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd >Thread-14::DEBUG::2014-09-09 09:54:20,844::__init__::225::IOProcess::(_processLogs) (16) Finding callback 'readfile'... >Thread-14::DEBUG::2014-09-09 09:54:20,845::__init__::225::IOProcess::(_processLogs) (16) Got request for method 'readfile' >Thread-14::DEBUG::2014-09-09 09:54:20,845::__init__::225::IOProcess::(_processLogs) Message size is 146DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:20,845::__init__::225::IOProcess::(_processLogs) Message size is 163 >Thread-14::DEBUG::2014-09-09 09:54:20,845::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-17::DEBUG::2014-09-09 09:54:20,845::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=iso', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=00000002-0002-0002-0002-000000000047,6d2495f3-efe4-4aa1-ab93-bdb0f6860cee,ff41f65c-09ac-40aa-8917-4b3ca8719aec,a69c4d84-3114-4937-aace-2079ce66b10b,7b90a9ec-ecb3-4105-b817-306ffc0b8245,be744655-2a19-4919-92f3-e7c20ac03193,0650ae6a-530a-4208-a13a-668025352382,528420e2-28d3-42c0-a243-a72c2dc0bd04,5fa7190c-833d-4b62-8524-a114f6ce5a79,4ed9221c-909e-4b58-998d-6140b9c241d0,00000002-0002-0002-0002-00000000034b,ca74573b-dc89-4785-92a8-5fdcc079f4df,00000002-0002-0002-0002-0000000001e1,aab45993-c5cf-436e-b55a-873bd83681d2,1ac20b5a-4433-4c04-bbc7-33d7eb3fd41f,d0089906-9093-4e45-91f4-2c73256f3dd3,9d8913f8-c9ee-4216-b161-a9ead1047fb9,f201c1d3-166d-42b0-ab69-0920a6dc279f,a1d01b58-6574-432d-b2df-2054ffca7eab,25a09b8a-177c-40af-865d-22436da5cc66,aed40d3c-15fc-45d2-bcba-da1398ae3d14,5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/iso', 'ROLE=Regular', 'SDUUID=e453999e-ec9f-420b-941c-a9f9cc4432bb', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=3ab7cad61661fbee975ab14bc6a1ca5540004e85'] >Thread-14::DEBUG::2014-09-09 09:54:20,845::__init__::225::IOProcess::(_processLogs) Message size is 146DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:20,846::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-13::DEBUG::2014-09-09 09:54:20,847::threadPool::35::Storage.ThreadPool::(__init__) Enter - numThreads: 5, waitTimeout: 3, maxTasks: 500 >Thread-14::DEBUG::2014-09-09 09:54:20,847::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:20,849::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:20,850::__init__::225::IOProcess::(_processLogs) (17) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:54:20,851::__init__::225::IOProcess::(_processLogs) (17) Got request for method 'access' >Thread-13::DEBUG::2014-09-09 09:54:20,851::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) /usr/bin/dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=16 (cwd None) >Thread-14::DEBUG::2014-09-09 09:54:20,852::__init__::225::IOProcess::(_processLogs) (16) Building response >Thread-14::DEBUG::2014-09-09 09:54:20,856::__init__::225::IOProcess::(_processLogs) (16) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:20,856::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:20,856::__init__::225::IOProcess::(_processLogs) Sending response sized 1552 >Thread-14::DEBUG::2014-09-09 09:54:20,857::__init__::225::IOProcess::(_processLogs) Message size is 146DEBUG|(17) Building response >Thread-14::DEBUG::2014-09-09 09:54:20,857::__init__::225::IOProcess::(_processLogs) (17) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:20,857::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:20,857::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-14::DEBUG::2014-09-09 09:54:20,857::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:20,857::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-14::DEBUG::2014-09-09 09:54:20,858::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:20,858::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:20,858::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:20,858::__init__::225::IOProcess::(_processLogs) Message size is 146DEBUG|Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:20,858::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:20,859::__init__::225::IOProcess::(_processLogs) (18) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:54:20,859::__init__::225::IOProcess::(_processLogs) (18) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:54:20,859::__init__::225::IOProcess::(_processLogs) (18) Building response >Thread-14::DEBUG::2014-09-09 09:54:20,859::__init__::225::IOProcess::(_processLogs) (18) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:20,859::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:20,859::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-14::DEBUG::2014-09-09 09:54:20,859::__init__::225::IOProcess::(_processLogs) Message size is 146DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:20,859::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-14::DEBUG::2014-09-09 09:54:20,860::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:20,860::__init__::225::IOProcess::(_processLogs) Message size is 146DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:20,860::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:20,860::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:20,860::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:20,860::__init__::225::IOProcess::(_processLogs) (19) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:54:20,860::__init__::225::IOProcess::(_processLogs) (19) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:54:20,861::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:20,861::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-14::DEBUG::2014-09-09 09:54:20,861::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:20,861::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:20,861::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:20,861::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:20,861::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:20,862::__init__::225::IOProcess::(_processLogs) (20) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-09 09:54:20,862::__init__::225::IOProcess::(_processLogs) (20) Got request for method 'glob' >Thread-14::DEBUG::2014-09-09 09:54:20,862::__init__::225::IOProcess::(_processLogs) (19) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:20,862::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:20,862::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-14::DEBUG::2014-09-09 09:54:20,862::__init__::225::IOProcess::(_processLogs) (20) Building response >Thread-14::DEBUG::2014-09-09 09:54:20,862::__init__::225::IOProcess::(_processLogs) (20) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:20,863::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:20,863::__init__::225::IOProcess::(_processLogs) Sending response sized 52 >Thread-17::DEBUG::2014-09-09 09:54:20,863::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-14::DEBUG::2014-09-09 09:54:20,863::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-17::DEBUG::2014-09-09 09:54:20,864::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'e453999e-ec9f-420b-941c-a9f9cc4432bb_imageNS' >Thread-14::DEBUG::2014-09-09 09:54:20,864::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-13::DEBUG::2014-09-09 09:54:20,865::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00643891 s, 636 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-09-09 09:54:20,866::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'e453999e-ec9f-420b-941c-a9f9cc4432bb_volumeNS' >Thread-14::DEBUG::2014-09-09 09:54:20,866::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-13::INFO::2014-09-09 09:54:20,866::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/usr/bin/dd', 'of=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=16'] >Thread-14::DEBUG::2014-09-09 09:54:20,867::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-13::DEBUG::2014-09-09 09:54:20,868::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) /usr/bin/dd of=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=16 (cwd None) >Thread-14::DEBUG::2014-09-09 09:54:20,869::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:20,873::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:20,873::__init__::225::IOProcess::(_processLogs) (21) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:54:20,873::__init__::225::IOProcess::(_processLogs) (21) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:54:20,873::__init__::225::IOProcess::(_processLogs) (21) Queuing response >Thread-19::DEBUG::2014-09-09 09:54:20,873::domainMonitor::264::Storage.DomainMonitorThread::(_monitorDomain) Domain caf02237-e8a4-49fe-ab6d-4d23843f0edf changed its status to Valid >Thread-14::DEBUG::2014-09-09 09:54:20,874::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-09-09 09:54:20,875::misc::821::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-14::DEBUG::2014-09-09 09:54:20,875::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-28::DEBUG::2014-09-09 09:54:20,875::misc::831::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms` >Thread-14::DEBUG::2014-09-09 09:54:20,877::__init__::225::IOProcess::(_processLogs) Message size is 145 >Thread-28::DEBUG::2014-09-09 09:54:20,877::misc::841::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Thread-29::INFO::2014-09-09 09:54:20,877::clientIF::136::vds::(contEIOVms) vmContainerLock acquired >Thread-14::DEBUG::2014-09-09 09:54:20,877::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:20,878::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:20,878::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:20,878::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:20,878::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:20,878::__init__::225::IOProcess::(_processLogs) (22) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:54:20,878::__init__::225::IOProcess::(_processLogs) (22) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:54:20,879::__init__::225::IOProcess::(_processLogs) (22) Queuing response >Thread-17::DEBUG::2014-09-09 09:54:20,879::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-09 09:54:20,879::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:20,883::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-17::DEBUG::2014-09-09 09:54:20,885::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00103201 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-09 09:54:20,886::__init__::225::IOProcess::(_processLogs) Message size is 145 >Thread-14::DEBUG::2014-09-09 09:54:20,886::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:20,886::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:20,886::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:20,886::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:20,886::__init__::225::IOProcess::(_processLogs) (23) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:54:20,886::__init__::225::IOProcess::(_processLogs) (23) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:54:20,886::__init__::225::IOProcess::(_processLogs) (23) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:20,887::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-17::DEBUG::2014-09-09 09:54:20,887::domainMonitor::264::Storage.DomainMonitorThread::(_monitorDomain) Domain e453999e-ec9f-420b-941c-a9f9cc4432bb changed its status to Valid >Thread-30::DEBUG::2014-09-09 09:54:20,887::misc::821::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-30::DEBUG::2014-09-09 09:54:20,888::misc::831::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms` >Thread-30::DEBUG::2014-09-09 09:54:20,888::misc::841::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Thread-31::INFO::2014-09-09 09:54:20,888::clientIF::136::vds::(contEIOVms) vmContainerLock acquired >Thread-13::DEBUG::2014-09-09 09:54:21,287::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.413133 s, 9.9 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-09-09 09:54:21,287::storage_mailbox::207::Storage.Mailbox.HSM::(__init__) HSM_MailboxMonitor created for pool 5745e11d-81b4-4d82-8fed-c8a22ec23383 >Thread-13::DEBUG::2014-09-09 09:54:21,287::sp::462::Storage.StoragePool::(__createMailboxMonitor) HSM mailbox ready for pool 5745e11d-81b4-4d82-8fed-c8a22ec23383 on master domain caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-13::DEBUG::2014-09-09 09:54:21,288::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-13::DEBUG::2014-09-09 09:54:21,288::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-13::DEBUG::2014-09-09 09:54:21,288::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-13::DEBUG::2014-09-09 09:54:21,288::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-13::DEBUG::2014-09-09 09:54:21,288::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-13::DEBUG::2014-09-09 09:54:21,288::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-13::DEBUG::2014-09-09 09:54:21,288::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-13::DEBUG::2014-09-09 09:54:21,288::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-13::INFO::2014-09-09 09:54:21,288::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-13::DEBUG::2014-09-09 09:54:21,289::task::1191::Storage.TaskManager.Task::(prepare) Task=`3e9ae6af-3492-4574-bdf0-b8ca37f38042`::finished: True >Thread-13::DEBUG::2014-09-09 09:54:21,289::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e9ae6af-3492-4574-bdf0-b8ca37f38042`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-09-09 09:54:21,289::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-09-09 09:54:21,289::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-09-09 09:54:21,289::task::993::Storage.TaskManager.Task::(_decref) Task=`3e9ae6af-3492-4574-bdf0-b8ca37f38042`::ref 0 aborting False >Thread-13::DEBUG::2014-09-09 09:54:21,297::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9fc1826-b1a0-497b-ae9f-03a64e82cbf4`::moving from state init -> state preparing >Thread-13::INFO::2014-09-09 09:54:21,297::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-09-09 09:54:21,297::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103201', 'lastCheck': '0.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000920667', 'lastCheck': '0.4', 'valid': True}} >Thread-13::DEBUG::2014-09-09 09:54:21,298::task::1191::Storage.TaskManager.Task::(prepare) Task=`a9fc1826-b1a0-497b-ae9f-03a64e82cbf4`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103201', 'lastCheck': '0.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000920667', 'lastCheck': '0.4', 'valid': True}} >Thread-13::DEBUG::2014-09-09 09:54:21,298::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9fc1826-b1a0-497b-ae9f-03a64e82cbf4`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-09-09 09:54:21,298::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-09-09 09:54:21,298::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-09-09 09:54:21,298::task::993::Storage.TaskManager.Task::(_decref) Task=`a9fc1826-b1a0-497b-ae9f-03a64e82cbf4`::ref 0 aborting False >Thread-13::DEBUG::2014-09-09 09:54:21,313::BindingXMLRPC::1132::vds::(wrapper) client [192.168.2.1]::call setMOMPolicyParameters with ({'balloonEnabled': False, 'ksmEnabled': False},) {} flowID [557b1013] >Thread-13::DEBUG::2014-09-09 09:54:21,359::BindingXMLRPC::1139::vds::(wrapper) return setMOMPolicyParameters with {'status': {'message': 'Done', 'code': 0}} >Thread-13::DEBUG::2014-09-09 09:54:27,587::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ca93c42-18cf-4ce8-ab87-8a33aa61b219`::moving from state init -> state preparing >Thread-13::INFO::2014-09-09 09:54:27,587::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-09-09 09:54:27,587::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103201', 'lastCheck': '6.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000920667', 'lastCheck': '6.7', 'valid': True}} >Thread-13::DEBUG::2014-09-09 09:54:27,587::task::1191::Storage.TaskManager.Task::(prepare) Task=`5ca93c42-18cf-4ce8-ab87-8a33aa61b219`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103201', 'lastCheck': '6.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000920667', 'lastCheck': '6.7', 'valid': True}} >Thread-13::DEBUG::2014-09-09 09:54:27,588::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ca93c42-18cf-4ce8-ab87-8a33aa61b219`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-09-09 09:54:27,588::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-09-09 09:54:27,588::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-09-09 09:54:27,588::task::993::Storage.TaskManager.Task::(_decref) Task=`5ca93c42-18cf-4ce8-ab87-8a33aa61b219`::ref 0 aborting False >Thread-14::DEBUG::2014-09-09 09:54:30,875::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-09 09:54:30,875::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:30,875::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:30,875::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:30,875::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:30,876::__init__::225::IOProcess::(_processLogs) (24) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:54:30,876::__init__::225::IOProcess::(_processLogs) (24) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:54:30,876::__init__::225::IOProcess::(_processLogs) (24) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:30,876::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-09-09 09:54:30,877::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 09:54:30,883::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n504 bytes (504 B) copied, 0.000922297 s, 546 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-09 09:54:30,884::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-09 09:54:30,884::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:30,884::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:30,884::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:30,884::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:30,884::__init__::225::IOProcess::(_processLogs) (25) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:54:30,884::__init__::225::IOProcess::(_processLogs) (25) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:54:30,884::__init__::225::IOProcess::(_processLogs) (25) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:30,885::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-14::DEBUG::2014-09-09 09:54:30,885::__init__::225::IOProcess::(_processLogs) Message size is 163 >Thread-14::DEBUG::2014-09-09 09:54:30,885::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:30,886::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:30,886::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:30,886::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:30,886::__init__::225::IOProcess::(_processLogs) (26) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:54:30,886::__init__::225::IOProcess::(_processLogs) (26) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:54:30,886::__init__::225::IOProcess::(_processLogs) (26) Building response >Thread-14::DEBUG::2014-09-09 09:54:30,886::__init__::225::IOProcess::(_processLogs) (26) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:30,886::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:30,886::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-14::DEBUG::2014-09-09 09:54:30,886::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-14::DEBUG::2014-09-09 09:54:30,887::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:30,887::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:30,887::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:30,887::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:30,887::__init__::225::IOProcess::(_processLogs) (27) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:54:30,887::__init__::225::IOProcess::(_processLogs) (27) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:54:30,887::__init__::225::IOProcess::(_processLogs) (27) Building response >Thread-14::DEBUG::2014-09-09 09:54:30,887::__init__::225::IOProcess::(_processLogs) (27) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:30,888::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:30,888::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-14::DEBUG::2014-09-09 09:54:30,888::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-14::DEBUG::2014-09-09 09:54:30,888::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:30,888::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:30,889::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:30,889::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:30,889::__init__::225::IOProcess::(_processLogs) (28) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:54:30,889::__init__::225::IOProcess::(_processLogs) (28) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:54:30,889::__init__::225::IOProcess::(_processLogs) (28) Building response >Thread-14::DEBUG::2014-09-09 09:54:30,889::__init__::225::IOProcess::(_processLogs) (28) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:30,889::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:30,889::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-14::DEBUG::2014-09-09 09:54:30,889::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:30,890::__init__::225::IOProcess::(_processLogs) Message size is 145 >Thread-14::DEBUG::2014-09-09 09:54:30,890::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:30,890::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:30,890::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:30,890::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:30,890::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:30,890::__init__::225::IOProcess::(_processLogs) (29) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:54:30,890::__init__::225::IOProcess::(_processLogs) (29) Got request for method 'statvfs' >Thread-17::DEBUG::2014-09-09 09:54:30,891::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-09 09:54:30,891::__init__::225::IOProcess::(_processLogs) (29) Building response >Thread-14::DEBUG::2014-09-09 09:54:30,895::__init__::225::IOProcess::(_processLogs) (29) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:30,895::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:30,895::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-17::DEBUG::2014-09-09 09:54:30,897::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00108649 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-09 09:54:30,898::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:30,898::__init__::225::IOProcess::(_processLogs) Message size is 145 >Thread-14::DEBUG::2014-09-09 09:54:30,898::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:30,898::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:30,898::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:30,898::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:30,898::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:30,898::__init__::225::IOProcess::(_processLogs) (30) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:54:30,899::__init__::225::IOProcess::(_processLogs) (30) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:54:30,899::__init__::225::IOProcess::(_processLogs) DEBUG|(30) Building response >Thread-14::DEBUG::2014-09-09 09:54:30,899::__init__::225::IOProcess::(_processLogs) (30) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:30,899::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-14::DEBUG::2014-09-09 09:54:30,900::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-13::DEBUG::2014-09-09 09:54:38,346::BindingXMLRPC::318::vds::(wrapper) client [192.168.2.1] flowID [9e06734] >Thread-13::DEBUG::2014-09-09 09:54:38,346::task::595::Storage.TaskManager.Task::(_updateState) Task=`27fd42b6-5a32-4828-b131-6834ec3ede5a`::moving from state init -> state preparing >Thread-13::INFO::2014-09-09 09:54:38,346::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-13::ERROR::2014-09-09 09:54:38,347::task::866::Storage.TaskManager.Task::(_setError) Task=`27fd42b6-5a32-4828-b131-6834ec3ede5a`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 873, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 45, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 611, in getSpmStatus > status = self._getSpmStatusInfo(pool) > File "/usr/share/vdsm/storage/hsm.py", line 605, in _getSpmStatusInfo > (pool.spmRole,) + pool.getSpmStatus())) > File "/usr/share/vdsm/storage/sp.py", line 126, in getSpmStatus > return self._backend.getSpmStatus() > File "/usr/share/vdsm/storage/spbackends.py", line 416, in getSpmStatus > lVer, spmId = self.masterDomain.inquireClusterLock() > File "/usr/share/vdsm/storage/sd.py", line 515, in inquireClusterLock > return self._clusterLock.inquire() > File "/usr/share/vdsm/storage/clusterlock.py", line 149, in inquire > raise InquireNotSupportedError() >InquireNotSupportedError >Thread-13::DEBUG::2014-09-09 09:54:38,348::task::885::Storage.TaskManager.Task::(_run) Task=`27fd42b6-5a32-4828-b131-6834ec3ede5a`::Task._run: 27fd42b6-5a32-4828-b131-6834ec3ede5a ('5745e11d-81b4-4d82-8fed-c8a22ec23383',) {} failed - stopping task >Thread-13::DEBUG::2014-09-09 09:54:38,348::task::1217::Storage.TaskManager.Task::(stop) Task=`27fd42b6-5a32-4828-b131-6834ec3ede5a`::stopping in state preparing (force False) >Thread-13::DEBUG::2014-09-09 09:54:38,348::task::993::Storage.TaskManager.Task::(_decref) Task=`27fd42b6-5a32-4828-b131-6834ec3ede5a`::ref 1 aborting True >Thread-13::INFO::2014-09-09 09:54:38,348::task::1171::Storage.TaskManager.Task::(prepare) Task=`27fd42b6-5a32-4828-b131-6834ec3ede5a`::aborting: Task is aborted: u'' - code 100 >Thread-13::DEBUG::2014-09-09 09:54:38,348::task::1176::Storage.TaskManager.Task::(prepare) Task=`27fd42b6-5a32-4828-b131-6834ec3ede5a`::Prepare: aborted: >Thread-13::DEBUG::2014-09-09 09:54:38,348::task::993::Storage.TaskManager.Task::(_decref) Task=`27fd42b6-5a32-4828-b131-6834ec3ede5a`::ref 0 aborting True >Thread-13::DEBUG::2014-09-09 09:54:38,349::task::928::Storage.TaskManager.Task::(_doAbort) Task=`27fd42b6-5a32-4828-b131-6834ec3ede5a`::Task._doAbort: force False >Thread-13::DEBUG::2014-09-09 09:54:38,349::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-09-09 09:54:38,349::task::595::Storage.TaskManager.Task::(_updateState) Task=`27fd42b6-5a32-4828-b131-6834ec3ede5a`::moving from state preparing -> state aborting >Thread-13::DEBUG::2014-09-09 09:54:38,349::task::550::Storage.TaskManager.Task::(__state_aborting) Task=`27fd42b6-5a32-4828-b131-6834ec3ede5a`::_aborting: recover policy none >Thread-13::DEBUG::2014-09-09 09:54:38,349::task::595::Storage.TaskManager.Task::(_updateState) Task=`27fd42b6-5a32-4828-b131-6834ec3ede5a`::moving from state aborting -> state failed >Thread-13::DEBUG::2014-09-09 09:54:38,349::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-09-09 09:54:38,349::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::ERROR::2014-09-09 09:54:38,349::dispatcher::79::Storage.Dispatcher::(wrapper) >Traceback (most recent call last): > File "/usr/share/vdsm/storage/dispatcher.py", line 71, in wrapper > result = ctask.prepare(func, *args, **kwargs) > File "/usr/share/vdsm/storage/task.py", line 103, in wrapper > return m(self, *a, **kw) > File "/usr/share/vdsm/storage/task.py", line 1179, in prepare > raise self.error >InquireNotSupportedError >Thread-14::DEBUG::2014-09-09 09:54:40,889::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:40,889::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-09 09:54:40,889::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:40,890::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:40,890::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:40,890::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:40,890::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:40,890::__init__::225::IOProcess::(_processLogs) (31) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:54:40,890::__init__::225::IOProcess::(_processLogs) (31) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:54:40,890::__init__::225::IOProcess::(_processLogs) DEBUG|(31) Building response >Thread-14::DEBUG::2014-09-09 09:54:40,890::__init__::225::IOProcess::(_processLogs) (31) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:40,890::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:40,890::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 242 >Thread-19::DEBUG::2014-09-09 09:54:40,891::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 09:54:40,898::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n505 bytes (505 B) copied, 0.00090519 s, 558 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-09 09:54:40,899::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:40,899::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-09 09:54:40,899::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:40,899::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:40,899::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:40,899::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:40,899::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:40,899::__init__::225::IOProcess::(_processLogs) (32) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:54:40,899::__init__::225::IOProcess::(_processLogs) (32) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:54:40,899::__init__::225::IOProcess::(_processLogs) DEBUG|(32) Building response >Thread-14::DEBUG::2014-09-09 09:54:40,900::__init__::225::IOProcess::(_processLogs) (32) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:40,900::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:40,900::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 242 >Thread-14::DEBUG::2014-09-09 09:54:40,901::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:40,901::__init__::225::IOProcess::(_processLogs) Message size is 145 >Thread-14::DEBUG::2014-09-09 09:54:40,901::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:40,901::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:40,901::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:40,901::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:40,901::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:40,902::__init__::225::IOProcess::(_processLogs) (33) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:54:40,902::__init__::225::IOProcess::(_processLogs) (33) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:54:40,902::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:40,902::__init__::225::IOProcess::(_processLogs) Message size is 163 >Thread-14::DEBUG::2014-09-09 09:54:40,902::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:40,902::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:40,902::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:40,902::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:40,903::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:40,903::__init__::225::IOProcess::(_processLogs) (34) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:54:40,903::__init__::225::IOProcess::(_processLogs) (34) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:54:40,903::__init__::225::IOProcess::(_processLogs) (34) Building response >Thread-14::DEBUG::2014-09-09 09:54:40,903::__init__::225::IOProcess::(_processLogs) (34) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:40,903::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:40,903::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-14::DEBUG::2014-09-09 09:54:40,903::__init__::225::IOProcess::(_processLogs) (33) Building response >Thread-14::DEBUG::2014-09-09 09:54:40,903::__init__::225::IOProcess::(_processLogs) (33) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:40,903::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:40,903::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-14::DEBUG::2014-09-09 09:54:40,904::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-17::DEBUG::2014-09-09 09:54:40,904::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-09 09:54:40,904::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-14::DEBUG::2014-09-09 09:54:40,908::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:40,909::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:40,909::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:40,909::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:40,909::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:40,909::__init__::225::IOProcess::(_processLogs) (35) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:54:40,909::__init__::225::IOProcess::(_processLogs) (35) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:54:40,909::__init__::225::IOProcess::(_processLogs) (35) Building response >Thread-14::DEBUG::2014-09-09 09:54:40,909::__init__::225::IOProcess::(_processLogs) (35) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:40,909::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:40,909::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-14::DEBUG::2014-09-09 09:54:40,910::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:40,910::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-14::DEBUG::2014-09-09 09:54:40,910::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-17::DEBUG::2014-09-09 09:54:40,911::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.000982548 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-09 09:54:40,911::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:40,912::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:40,912::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:40,912::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:40,912::__init__::225::IOProcess::(_processLogs) (36) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:54:40,912::__init__::225::IOProcess::(_processLogs) (36) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:54:40,912::__init__::225::IOProcess::(_processLogs) (36) Building response >Thread-14::DEBUG::2014-09-09 09:54:40,912::__init__::225::IOProcess::(_processLogs) (36) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:40,913::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:40,913::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-14::DEBUG::2014-09-09 09:54:40,913::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:40,913::__init__::225::IOProcess::(_processLogs) Message size is 145 >Thread-14::DEBUG::2014-09-09 09:54:40,913::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:40,913::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:40,913::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:40,913::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:40,913::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:40,913::__init__::225::IOProcess::(_processLogs) (37) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:54:40,913::__init__::225::IOProcess::(_processLogs) (37) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:54:40,914::__init__::225::IOProcess::(_processLogs) DEBUG|(37) Building response >Thread-14::DEBUG::2014-09-09 09:54:40,914::__init__::225::IOProcess::(_processLogs) (37) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:40,914::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-14::DEBUG::2014-09-09 09:54:40,915::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-13::DEBUG::2014-09-09 09:54:42,717::task::595::Storage.TaskManager.Task::(_updateState) Task=`03dfab21-74f2-4b05-9670-bfdfcab0c1f0`::moving from state init -> state preparing >Thread-13::INFO::2014-09-09 09:54:42,717::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-09-09 09:54:42,717::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000982548', 'lastCheck': '1.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00090519', 'lastCheck': '1.8', 'valid': True}} >Thread-13::DEBUG::2014-09-09 09:54:42,717::task::1191::Storage.TaskManager.Task::(prepare) Task=`03dfab21-74f2-4b05-9670-bfdfcab0c1f0`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000982548', 'lastCheck': '1.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00090519', 'lastCheck': '1.8', 'valid': True}} >Thread-13::DEBUG::2014-09-09 09:54:42,717::task::595::Storage.TaskManager.Task::(_updateState) Task=`03dfab21-74f2-4b05-9670-bfdfcab0c1f0`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-09-09 09:54:42,717::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-09-09 09:54:42,717::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-09-09 09:54:42,717::task::993::Storage.TaskManager.Task::(_decref) Task=`03dfab21-74f2-4b05-9670-bfdfcab0c1f0`::ref 0 aborting False >Thread-13::DEBUG::2014-09-09 09:54:48,414::BindingXMLRPC::318::vds::(wrapper) client [192.168.2.1] >Thread-13::DEBUG::2014-09-09 09:54:48,414::task::595::Storage.TaskManager.Task::(_updateState) Task=`03150c76-ab4e-406b-bc75-023966024fdb`::moving from state init -> state preparing >Thread-13::INFO::2014-09-09 09:54:48,414::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-13::ERROR::2014-09-09 09:54:48,414::task::866::Storage.TaskManager.Task::(_setError) Task=`03150c76-ab4e-406b-bc75-023966024fdb`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 873, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 45, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 611, in getSpmStatus > status = self._getSpmStatusInfo(pool) > File "/usr/share/vdsm/storage/hsm.py", line 605, in _getSpmStatusInfo > (pool.spmRole,) + pool.getSpmStatus())) > File "/usr/share/vdsm/storage/sp.py", line 126, in getSpmStatus > return self._backend.getSpmStatus() > File "/usr/share/vdsm/storage/spbackends.py", line 416, in getSpmStatus > lVer, spmId = self.masterDomain.inquireClusterLock() > File "/usr/share/vdsm/storage/sd.py", line 515, in inquireClusterLock > return self._clusterLock.inquire() > File "/usr/share/vdsm/storage/clusterlock.py", line 149, in inquire > raise InquireNotSupportedError() >InquireNotSupportedError >Thread-13::DEBUG::2014-09-09 09:54:48,414::task::885::Storage.TaskManager.Task::(_run) Task=`03150c76-ab4e-406b-bc75-023966024fdb`::Task._run: 03150c76-ab4e-406b-bc75-023966024fdb ('5745e11d-81b4-4d82-8fed-c8a22ec23383',) {} failed - stopping task >Thread-13::DEBUG::2014-09-09 09:54:48,415::task::1217::Storage.TaskManager.Task::(stop) Task=`03150c76-ab4e-406b-bc75-023966024fdb`::stopping in state preparing (force False) >Thread-13::DEBUG::2014-09-09 09:54:48,415::task::993::Storage.TaskManager.Task::(_decref) Task=`03150c76-ab4e-406b-bc75-023966024fdb`::ref 1 aborting True >Thread-13::INFO::2014-09-09 09:54:48,415::task::1171::Storage.TaskManager.Task::(prepare) Task=`03150c76-ab4e-406b-bc75-023966024fdb`::aborting: Task is aborted: u'' - code 100 >Thread-13::DEBUG::2014-09-09 09:54:48,415::task::1176::Storage.TaskManager.Task::(prepare) Task=`03150c76-ab4e-406b-bc75-023966024fdb`::Prepare: aborted: >Thread-13::DEBUG::2014-09-09 09:54:48,415::task::993::Storage.TaskManager.Task::(_decref) Task=`03150c76-ab4e-406b-bc75-023966024fdb`::ref 0 aborting True >Thread-13::DEBUG::2014-09-09 09:54:48,415::task::928::Storage.TaskManager.Task::(_doAbort) Task=`03150c76-ab4e-406b-bc75-023966024fdb`::Task._doAbort: force False >Thread-13::DEBUG::2014-09-09 09:54:48,415::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-09-09 09:54:48,415::task::595::Storage.TaskManager.Task::(_updateState) Task=`03150c76-ab4e-406b-bc75-023966024fdb`::moving from state preparing -> state aborting >Thread-13::DEBUG::2014-09-09 09:54:48,415::task::550::Storage.TaskManager.Task::(__state_aborting) Task=`03150c76-ab4e-406b-bc75-023966024fdb`::_aborting: recover policy none >Thread-13::DEBUG::2014-09-09 09:54:48,415::task::595::Storage.TaskManager.Task::(_updateState) Task=`03150c76-ab4e-406b-bc75-023966024fdb`::moving from state aborting -> state failed >Thread-13::DEBUG::2014-09-09 09:54:48,415::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-09-09 09:54:48,415::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::ERROR::2014-09-09 09:54:48,415::dispatcher::79::Storage.Dispatcher::(wrapper) >Traceback (most recent call last): > File "/usr/share/vdsm/storage/dispatcher.py", line 71, in wrapper > result = ctask.prepare(func, *args, **kwargs) > File "/usr/share/vdsm/storage/task.py", line 103, in wrapper > return m(self, *a, **kw) > File "/usr/share/vdsm/storage/task.py", line 1179, in prepare > raise self.error >InquireNotSupportedError >Thread-14::DEBUG::2014-09-09 09:54:50,912::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:50,912::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-09 09:54:50,913::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:50,913::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:50,913::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:50,913::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:50,913::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:50,913::__init__::225::IOProcess::(_processLogs) (38) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:54:50,913::__init__::225::IOProcess::(_processLogs) (38) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:54:50,915::__init__::225::IOProcess::(_processLogs) DEBUG|(38) Building response >Thread-14::DEBUG::2014-09-09 09:54:50,915::__init__::225::IOProcess::(_processLogs) (38) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:50,915::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:50,915::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-14::DEBUG::2014-09-09 09:54:50,916::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 09:54:50,916::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-09 09:54:50,916::__init__::225::IOProcess::(_processLogs) Message size is 145 >Thread-14::DEBUG::2014-09-09 09:54:50,920::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:50,920::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:50,921::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:50,921::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:50,921::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:50,921::__init__::225::IOProcess::(_processLogs) (39) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:54:50,921::__init__::225::IOProcess::(_processLogs) (39) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:54:50,921::__init__::225::IOProcess::(_processLogs) DEBUG|(39) Building response >Thread-17::DEBUG::2014-09-09 09:54:50,922::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-09 09:54:50,922::__init__::225::IOProcess::(_processLogs) (39) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:50,926::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 09:54:50,927::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n505 bytes (505 B) copied, 0.0012999 s, 388 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-09 09:54:50,927::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-14::DEBUG::2014-09-09 09:54:50,928::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:50,928::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-09 09:54:50,928::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:50,928::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:50,928::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:50,928::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:50,928::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:50,928::__init__::225::IOProcess::(_processLogs) (40) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:54:50,928::__init__::225::IOProcess::(_processLogs) (40) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:54:50,928::__init__::225::IOProcess::(_processLogs) DEBUG|(40) Building response >Thread-14::DEBUG::2014-09-09 09:54:50,928::__init__::225::IOProcess::(_processLogs) (40) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:50,929::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:50,929::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 242 >Thread-17::DEBUG::2014-09-09 09:54:50,930::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.000844359 s, 1.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-09 09:54:50,930::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:50,931::__init__::225::IOProcess::(_processLogs) Message size is 163 >Thread-14::DEBUG::2014-09-09 09:54:50,931::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:50,931::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:50,931::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:50,931::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:50,931::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:50,931::__init__::225::IOProcess::(_processLogs) (41) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:54:50,932::__init__::225::IOProcess::(_processLogs) (41) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:54:50,932::__init__::225::IOProcess::(_processLogs) (41) Building response >Thread-14::DEBUG::2014-09-09 09:54:50,932::__init__::225::IOProcess::(_processLogs) (41) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:50,932::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:50,932::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-14::DEBUG::2014-09-09 09:54:50,932::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:50,932::__init__::225::IOProcess::(_processLogs) Message size is 145 >Thread-14::DEBUG::2014-09-09 09:54:50,932::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:50,932::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:50,932::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:50,932::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:50,933::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:50,933::__init__::225::IOProcess::(_processLogs) Message size is 167DEBUG|Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:50,933::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:50,933::__init__::225::IOProcess::(_processLogs) (42) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:54:50,933::__init__::225::IOProcess::(_processLogs) (42) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:54:50,933::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:50,933::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:50,933::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:50,933::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:50,933::__init__::225::IOProcess::(_processLogs) (43) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:54:50,933::__init__::225::IOProcess::(_processLogs) (43) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:54:50,934::__init__::225::IOProcess::(_processLogs) DEBUG|(43) Building response >Thread-14::DEBUG::2014-09-09 09:54:50,934::__init__::225::IOProcess::(_processLogs) (43) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:50,934::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:50,934::__init__::225::IOProcess::(_processLogs) (42) Building responseDEBUG|Sending response sized 54 >Thread-14::DEBUG::2014-09-09 09:54:50,934::__init__::225::IOProcess::(_processLogs) (42) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:50,934::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:50,934::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-14::DEBUG::2014-09-09 09:54:50,935::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:54:50,935::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-14::DEBUG::2014-09-09 09:54:50,935::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:54:50,935::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:54:50,935::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:54:50,936::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:54:50,936::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:54:50,936::__init__::225::IOProcess::(_processLogs) (44) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:54:50,936::__init__::225::IOProcess::(_processLogs) (44) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:54:50,936::__init__::225::IOProcess::(_processLogs) DEBUG|(44) Building response >Thread-14::DEBUG::2014-09-09 09:54:50,936::__init__::225::IOProcess::(_processLogs) (44) Queuing response >Thread-14::DEBUG::2014-09-09 09:54:50,936::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:54:50,937::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-13::DEBUG::2014-09-09 09:54:57,847::task::595::Storage.TaskManager.Task::(_updateState) Task=`ae05a7c1-b8d4-4c89-9835-3929ea85311b`::moving from state init -> state preparing >Thread-13::INFO::2014-09-09 09:54:57,848::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-09-09 09:54:57,848::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000844359', 'lastCheck': '6.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0012999', 'lastCheck': '6.9', 'valid': True}} >Thread-13::DEBUG::2014-09-09 09:54:57,848::task::1191::Storage.TaskManager.Task::(prepare) Task=`ae05a7c1-b8d4-4c89-9835-3929ea85311b`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000844359', 'lastCheck': '6.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0012999', 'lastCheck': '6.9', 'valid': True}} >Thread-13::DEBUG::2014-09-09 09:54:57,848::task::595::Storage.TaskManager.Task::(_updateState) Task=`ae05a7c1-b8d4-4c89-9835-3929ea85311b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-09-09 09:54:57,848::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-09-09 09:54:57,848::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-09-09 09:54:57,848::task::993::Storage.TaskManager.Task::(_decref) Task=`ae05a7c1-b8d4-4c89-9835-3929ea85311b`::ref 0 aborting False >Thread-13::DEBUG::2014-09-09 09:54:58,496::BindingXMLRPC::318::vds::(wrapper) client [192.168.2.1] >Thread-13::DEBUG::2014-09-09 09:54:58,496::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b915b91-282d-4c08-b00b-cef7b5d5f3d8`::moving from state init -> state preparing >Thread-13::INFO::2014-09-09 09:54:58,496::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-13::ERROR::2014-09-09 09:54:58,496::task::866::Storage.TaskManager.Task::(_setError) Task=`4b915b91-282d-4c08-b00b-cef7b5d5f3d8`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 873, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 45, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 611, in getSpmStatus > status = self._getSpmStatusInfo(pool) > File "/usr/share/vdsm/storage/hsm.py", line 605, in _getSpmStatusInfo > (pool.spmRole,) + pool.getSpmStatus())) > File "/usr/share/vdsm/storage/sp.py", line 126, in getSpmStatus > return self._backend.getSpmStatus() > File "/usr/share/vdsm/storage/spbackends.py", line 416, in getSpmStatus > lVer, spmId = self.masterDomain.inquireClusterLock() > File "/usr/share/vdsm/storage/sd.py", line 515, in inquireClusterLock > return self._clusterLock.inquire() > File "/usr/share/vdsm/storage/clusterlock.py", line 149, in inquire > raise InquireNotSupportedError() >InquireNotSupportedError >Thread-13::DEBUG::2014-09-09 09:54:58,496::task::885::Storage.TaskManager.Task::(_run) Task=`4b915b91-282d-4c08-b00b-cef7b5d5f3d8`::Task._run: 4b915b91-282d-4c08-b00b-cef7b5d5f3d8 ('5745e11d-81b4-4d82-8fed-c8a22ec23383',) {} failed - stopping task >Thread-13::DEBUG::2014-09-09 09:54:58,497::task::1217::Storage.TaskManager.Task::(stop) Task=`4b915b91-282d-4c08-b00b-cef7b5d5f3d8`::stopping in state preparing (force False) >Thread-13::DEBUG::2014-09-09 09:54:58,497::task::993::Storage.TaskManager.Task::(_decref) Task=`4b915b91-282d-4c08-b00b-cef7b5d5f3d8`::ref 1 aborting True >Thread-13::INFO::2014-09-09 09:54:58,497::task::1171::Storage.TaskManager.Task::(prepare) Task=`4b915b91-282d-4c08-b00b-cef7b5d5f3d8`::aborting: Task is aborted: u'' - code 100 >Thread-13::DEBUG::2014-09-09 09:54:58,497::task::1176::Storage.TaskManager.Task::(prepare) Task=`4b915b91-282d-4c08-b00b-cef7b5d5f3d8`::Prepare: aborted: >Thread-13::DEBUG::2014-09-09 09:54:58,497::task::993::Storage.TaskManager.Task::(_decref) Task=`4b915b91-282d-4c08-b00b-cef7b5d5f3d8`::ref 0 aborting True >Thread-13::DEBUG::2014-09-09 09:54:58,497::task::928::Storage.TaskManager.Task::(_doAbort) Task=`4b915b91-282d-4c08-b00b-cef7b5d5f3d8`::Task._doAbort: force False >Thread-13::DEBUG::2014-09-09 09:54:58,497::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-09-09 09:54:58,497::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b915b91-282d-4c08-b00b-cef7b5d5f3d8`::moving from state preparing -> state aborting >Thread-13::DEBUG::2014-09-09 09:54:58,497::task::550::Storage.TaskManager.Task::(__state_aborting) Task=`4b915b91-282d-4c08-b00b-cef7b5d5f3d8`::_aborting: recover policy none >Thread-13::DEBUG::2014-09-09 09:54:58,497::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b915b91-282d-4c08-b00b-cef7b5d5f3d8`::moving from state aborting -> state failed >Thread-13::DEBUG::2014-09-09 09:54:58,497::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-09-09 09:54:58,497::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::ERROR::2014-09-09 09:54:58,497::dispatcher::79::Storage.Dispatcher::(wrapper) >Traceback (most recent call last): > File "/usr/share/vdsm/storage/dispatcher.py", line 71, in wrapper > result = ctask.prepare(func, *args, **kwargs) > File "/usr/share/vdsm/storage/task.py", line 103, in wrapper > return m(self, *a, **kw) > File "/usr/share/vdsm/storage/task.py", line 1179, in prepare > raise self.error >InquireNotSupportedError >Thread-14::DEBUG::2014-09-09 09:55:00,936::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:00,936::__init__::225::IOProcess::(_processLogs) Message size is 145 >Thread-14::DEBUG::2014-09-09 09:55:00,936::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:00,936::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:00,936::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:00,936::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:00,936::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:00,936::__init__::225::IOProcess::(_processLogs) (45) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:55:00,936::__init__::225::IOProcess::(_processLogs) (45) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:55:00,937::__init__::225::IOProcess::(_processLogs) DEBUG|(45) Building response >Thread-17::DEBUG::2014-09-09 09:55:00,937::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-09 09:55:00,938::__init__::225::IOProcess::(_processLogs) (45) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:00,942::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:00,943::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-17::DEBUG::2014-09-09 09:55:00,944::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00108543 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-09 09:55:00,944::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:00,945::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-09 09:55:00,945::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:00,945::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:00,945::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:00,945::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:00,945::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:00,946::__init__::225::IOProcess::(_processLogs) (46) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:55:00,946::__init__::225::IOProcess::(_processLogs) (46) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:55:00,946::__init__::225::IOProcess::(_processLogs) DEBUG|(46) Building response >Thread-19::DEBUG::2014-09-09 09:55:00,946::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-09 09:55:00,947::__init__::225::IOProcess::(_processLogs) (46) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:00,950::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:00,951::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-14::DEBUG::2014-09-09 09:55:00,951::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:00,951::__init__::225::IOProcess::(_processLogs) Message size is 145 >Thread-14::DEBUG::2014-09-09 09:55:00,951::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:00,951::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:00,951::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:00,951::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:00,951::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:00,951::__init__::225::IOProcess::(_processLogs) (47) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:55:00,951::__init__::225::IOProcess::(_processLogs) (47) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:55:00,952::__init__::225::IOProcess::(_processLogs) (47) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:00,952::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-09-09 09:55:00,953::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n505 bytes (505 B) copied, 0.000830133 s, 608 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-09 09:55:00,953::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-09 09:55:00,953::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:00,953::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:00,953::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:00,954::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:00,954::__init__::225::IOProcess::(_processLogs) (48) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:55:00,954::__init__::225::IOProcess::(_processLogs) (48) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:55:00,954::__init__::225::IOProcess::(_processLogs) (48) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:00,954::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-14::DEBUG::2014-09-09 09:55:00,955::__init__::225::IOProcess::(_processLogs) Message size is 163 >Thread-14::DEBUG::2014-09-09 09:55:00,955::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:00,955::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:00,955::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:00,955::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:00,955::__init__::225::IOProcess::(_processLogs) (49) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:55:00,956::__init__::225::IOProcess::(_processLogs) (49) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:55:00,956::__init__::225::IOProcess::(_processLogs) (49) Building response >Thread-14::DEBUG::2014-09-09 09:55:00,956::__init__::225::IOProcess::(_processLogs) (49) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:00,956::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:00,956::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-14::DEBUG::2014-09-09 09:55:00,956::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-14::DEBUG::2014-09-09 09:55:00,956::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:00,956::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:00,956::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:00,956::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:00,956::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:00,957::__init__::225::IOProcess::(_processLogs) (50) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:55:00,957::__init__::225::IOProcess::(_processLogs) (50) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:55:00,957::__init__::225::IOProcess::(_processLogs) (50) Building response >Thread-14::DEBUG::2014-09-09 09:55:00,957::__init__::225::IOProcess::(_processLogs) (50) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:00,957::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:00,957::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-14::DEBUG::2014-09-09 09:55:00,957::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-14::DEBUG::2014-09-09 09:55:00,957::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:00,958::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:00,958::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:00,958::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:00,958::__init__::225::IOProcess::(_processLogs) (51) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:55:00,958::__init__::225::IOProcess::(_processLogs) (51) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:55:00,958::__init__::225::IOProcess::(_processLogs) (51) Building response >Thread-14::DEBUG::2014-09-09 09:55:00,958::__init__::225::IOProcess::(_processLogs) (51) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:00,959::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:00,959::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-14::DEBUG::2014-09-09 09:55:10,953::__init__::225::IOProcess::(_processLogs) Message size is 145 >Thread-14::DEBUG::2014-09-09 09:55:10,953::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:10,953::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:10,954::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:10,954::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:10,954::__init__::225::IOProcess::(_processLogs) (52) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:55:10,954::__init__::225::IOProcess::(_processLogs) (52) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:55:10,954::__init__::225::IOProcess::(_processLogs) (52) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:10,954::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-17::DEBUG::2014-09-09 09:55:10,955::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-09 09:55:10,959::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-09 09:55:10,959::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:10,959::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:10,959::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:10,959::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:10,960::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 09:55:10,960::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-09 09:55:10,960::__init__::225::IOProcess::(_processLogs) (53) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:55:10,965::__init__::225::IOProcess::(_processLogs) (53) Got request for method 'statvfs' >Thread-17::DEBUG::2014-09-09 09:55:10,965::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00105996 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-09 09:55:10,966::__init__::225::IOProcess::(_processLogs) (53) Building response >Thread-14::DEBUG::2014-09-09 09:55:10,966::__init__::225::IOProcess::(_processLogs) (53) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:10,966::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:10,966::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-14::DEBUG::2014-09-09 09:55:10,967::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:10,967::__init__::225::IOProcess::(_processLogs) DEBUG|Message size is 145 >Thread-14::DEBUG::2014-09-09 09:55:10,967::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:10,967::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:10,967::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:10,967::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:10,967::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:10,967::__init__::225::IOProcess::(_processLogs) (54) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:55:10,967::__init__::225::IOProcess::(_processLogs) (54) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:55:10,967::__init__::225::IOProcess::(_processLogs) DEBUG|(54) Building response >Thread-14::DEBUG::2014-09-09 09:55:10,967::__init__::225::IOProcess::(_processLogs) (54) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:10,968::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 09:55:10,969::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n505 bytes (505 B) copied, 0.00089526 s, 564 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-09 09:55:10,969::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-14::DEBUG::2014-09-09 09:55:10,969::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:10,970::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-09 09:55:10,970::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:10,970::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:10,970::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:10,970::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:10,970::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:10,970::__init__::225::IOProcess::(_processLogs) (55) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:55:10,970::__init__::225::IOProcess::(_processLogs) (55) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:55:10,970::__init__::225::IOProcess::(_processLogs) DEBUG|(55) Building response >Thread-14::DEBUG::2014-09-09 09:55:10,970::__init__::225::IOProcess::(_processLogs) (55) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:10,971::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-14::DEBUG::2014-09-09 09:55:10,971::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-14::DEBUG::2014-09-09 09:55:10,971::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:10,971::__init__::225::IOProcess::(_processLogs) Message size is 163 >Thread-14::DEBUG::2014-09-09 09:55:10,971::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:10,972::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:10,972::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:10,972::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:10,972::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:10,972::__init__::225::IOProcess::(_processLogs) (56) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:55:10,972::__init__::225::IOProcess::(_processLogs) (56) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:55:10,972::__init__::225::IOProcess::(_processLogs) (56) Building response >Thread-14::DEBUG::2014-09-09 09:55:10,972::__init__::225::IOProcess::(_processLogs) (56) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:10,972::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:10,972::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-14::DEBUG::2014-09-09 09:55:10,973::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:10,973::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-14::DEBUG::2014-09-09 09:55:10,973::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:10,973::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:10,973::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:10,973::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:10,973::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:10,974::__init__::225::IOProcess::(_processLogs) (57) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:55:10,974::__init__::225::IOProcess::(_processLogs) (57) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:55:10,974::__init__::225::IOProcess::(_processLogs) (57) Building response >Thread-14::DEBUG::2014-09-09 09:55:10,974::__init__::225::IOProcess::(_processLogs) (57) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:10,974::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:10,974::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-14::DEBUG::2014-09-09 09:55:10,974::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:10,974::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-14::DEBUG::2014-09-09 09:55:10,974::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:10,975::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:10,975::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:10,975::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:10,975::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:10,975::__init__::225::IOProcess::(_processLogs) (58) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:55:10,975::__init__::225::IOProcess::(_processLogs) (58) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:55:10,975::__init__::225::IOProcess::(_processLogs) (58) Building response >Thread-14::DEBUG::2014-09-09 09:55:10,975::__init__::225::IOProcess::(_processLogs) (58) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:10,975::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:10,975::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-13::DEBUG::2014-09-09 09:55:12,987::task::595::Storage.TaskManager.Task::(_updateState) Task=`149ec218-0ede-42b1-8bfe-f0897c598a64`::moving from state init -> state preparing >Thread-13::INFO::2014-09-09 09:55:12,987::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-09-09 09:55:12,987::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105996', 'lastCheck': '2.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00089526', 'lastCheck': '2.0', 'valid': True}} >Thread-13::DEBUG::2014-09-09 09:55:12,987::task::1191::Storage.TaskManager.Task::(prepare) Task=`149ec218-0ede-42b1-8bfe-f0897c598a64`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105996', 'lastCheck': '2.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00089526', 'lastCheck': '2.0', 'valid': True}} >Thread-13::DEBUG::2014-09-09 09:55:12,987::task::595::Storage.TaskManager.Task::(_updateState) Task=`149ec218-0ede-42b1-8bfe-f0897c598a64`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-09-09 09:55:12,987::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-09-09 09:55:12,987::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-09-09 09:55:12,988::task::993::Storage.TaskManager.Task::(_decref) Task=`149ec218-0ede-42b1-8bfe-f0897c598a64`::ref 0 aborting False >Thread-13::DEBUG::2014-09-09 09:55:19,120::task::595::Storage.TaskManager.Task::(_updateState) Task=`280795a2-2e76-4b12-87a6-ee5866f94607`::moving from state init -> state preparing >Thread-13::INFO::2014-09-09 09:55:19,120::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-09-09 09:55:19,120::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105996', 'lastCheck': '8.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00089526', 'lastCheck': '8.1', 'valid': True}} >Thread-13::DEBUG::2014-09-09 09:55:19,121::task::1191::Storage.TaskManager.Task::(prepare) Task=`280795a2-2e76-4b12-87a6-ee5866f94607`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105996', 'lastCheck': '8.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00089526', 'lastCheck': '8.1', 'valid': True}} >Thread-13::DEBUG::2014-09-09 09:55:19,121::task::595::Storage.TaskManager.Task::(_updateState) Task=`280795a2-2e76-4b12-87a6-ee5866f94607`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-09-09 09:55:19,121::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-09-09 09:55:19,121::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-09-09 09:55:19,121::task::993::Storage.TaskManager.Task::(_decref) Task=`280795a2-2e76-4b12-87a6-ee5866f94607`::ref 0 aborting False >Thread-13::DEBUG::2014-09-09 09:55:19,225::BindingXMLRPC::318::vds::(wrapper) client [192.168.2.1] >Thread-13::DEBUG::2014-09-09 09:55:19,225::task::595::Storage.TaskManager.Task::(_updateState) Task=`2bcc049c-1329-4286-97c3-c4748d8b4893`::moving from state init -> state preparing >Thread-13::INFO::2014-09-09 09:55:19,225::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='5745e11d-81b4-4d82-8fed-c8a22ec23383', hostID=2, remove=False, options=None) >Thread-13::DEBUG::2014-09-09 09:55:19,225::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d06e3dcd-d66e-4f5d-a63c-0214343552a8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1124' at 'disconnectStoragePool' >Thread-13::DEBUG::2014-09-09 09:55:19,225::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'exclusive' >Thread-13::DEBUG::2014-09-09 09:55:19,225::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'exclusive' (1 active user) >Thread-13::DEBUG::2014-09-09 09:55:19,225::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d06e3dcd-d66e-4f5d-a63c-0214343552a8`::Granted request >Thread-13::DEBUG::2014-09-09 09:55:19,226::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2bcc049c-1329-4286-97c3-c4748d8b4893`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (exclusive) >Thread-13::DEBUG::2014-09-09 09:55:19,226::task::993::Storage.TaskManager.Task::(_decref) Task=`2bcc049c-1329-4286-97c3-c4748d8b4893`::ref 1 aborting False >Thread-13::DEBUG::2014-09-09 09:55:19,226::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`5c0a4091-8f9e-48c4-998e-ae7bc880b75a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1132' at '_disconnectPool' >Thread-13::DEBUG::2014-09-09 09:55:19,226::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-13::DEBUG::2014-09-09 09:55:19,226::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-13::DEBUG::2014-09-09 09:55:19,226::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`5c0a4091-8f9e-48c4-998e-ae7bc880b75a`::Granted request >Thread-13::INFO::2014-09-09 09:55:19,226::sp::657::Storage.StoragePool::(disconnect) Disconnect from the storage pool 5745e11d-81b4-4d82-8fed-c8a22ec23383 >Thread-32::INFO::2014-09-09 09:55:19,291::storage_mailbox::509::Storage.MailBox.HsmMailMonitor::(run) HSM_MailboxMonitor - Incoming mail monitoring thread stopped, clearing outgoing mail >Thread-32::INFO::2014-09-09 09:55:19,291::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/usr/bin/dd', 'of=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=16'] >Thread-32::DEBUG::2014-09-09 09:55:19,291::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) /usr/bin/dd of=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=16 (cwd None) >Thread-32::DEBUG::2014-09-09 09:55:19,696::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.399926 s, 10.2 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-09-09 09:55:20,853::fileUtils::124::Storage.fileUtils::(cleanupdir) Removing directory: /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383 >Thread-13::INFO::2014-09-09 09:55:20,854::domainMonitor::114::Storage.DomainMonitor::(stopMonitoring) Stop monitoring e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-17::DEBUG::2014-09-09 09:55:20,854::domainMonitor::192::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-13::INFO::2014-09-09 09:55:20,854::domainMonitor::114::Storage.DomainMonitor::(stopMonitoring) Stop monitoring caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-19::DEBUG::2014-09-09 09:55:20,854::domainMonitor::192::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-19::DEBUG::2014-09-09 09:55:20,854::clusterlock::116::Storage.SafeLease::(releaseHostId) Host id for domain caf02237-e8a4-49fe-ab6d-4d23843f0edf released successfully (id: 2) >Thread-13::DEBUG::2014-09-09 09:55:20,855::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-13::DEBUG::2014-09-09 09:55:20,855::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-13::DEBUG::2014-09-09 09:55:20,855::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-13::DEBUG::2014-09-09 09:55:20,855::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-13::INFO::2014-09-09 09:55:20,855::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: True >Thread-13::DEBUG::2014-09-09 09:55:20,855::task::1191::Storage.TaskManager.Task::(prepare) Task=`2bcc049c-1329-4286-97c3-c4748d8b4893`::finished: True >Thread-13::DEBUG::2014-09-09 09:55:20,855::task::595::Storage.TaskManager.Task::(_updateState) Task=`2bcc049c-1329-4286-97c3-c4748d8b4893`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-09-09 09:55:20,855::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-13::DEBUG::2014-09-09 09:55:20,855::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-09-09 09:55:20,855::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-13::DEBUG::2014-09-09 09:55:20,856::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-13::DEBUG::2014-09-09 09:55:20,856::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-13::DEBUG::2014-09-09 09:55:20,856::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-13::DEBUG::2014-09-09 09:55:20,856::task::993::Storage.TaskManager.Task::(_decref) Task=`2bcc049c-1329-4286-97c3-c4748d8b4893`::ref 0 aborting False >Thread-13::DEBUG::2014-09-09 09:55:20,883::BindingXMLRPC::318::vds::(wrapper) client [192.168.2.1] flowID [70c71b52] >Thread-13::DEBUG::2014-09-09 09:55:20,883::task::595::Storage.TaskManager.Task::(_updateState) Task=`d38d7550-3bf7-4ad0-9702-668646e861a5`::moving from state init -> state preparing >Thread-13::INFO::2014-09-09 09:55:20,884::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='5745e11d-81b4-4d82-8fed-c8a22ec23383', conList=[{'connection': '192.168.2.1:/home/storage/iso', 'iqn': '', 'user': '', 'tpgt': '1', 'password': '******', 'id': '627a78ed-6123-4e11-a839-63b100459bc3', 'port': ''}, {'connection': '192.168.2.1:/home/storage/data', 'iqn': '', 'user': '', 'tpgt': '1', 'password': '******', 'id': 'b2429c9b-0750-46f1-a95a-ec0448e6435d', 'port': ''}], options=None) >Thread-13::DEBUG::2014-09-09 09:55:20,884::mount::227::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /usr/bin/umount -f -l /rhev/data-center/mnt/192.168.2.1:_home_storage_iso (cwd None) >Thread-13::DEBUG::2014-09-09 09:55:20,927::mount::227::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /usr/bin/umount -f -l /rhev/data-center/mnt/192.168.2.1:_home_storage_data (cwd None) >Thread-13::DEBUG::2014-09-09 09:55:20,937::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-13::DEBUG::2014-09-09 09:55:20,937::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-13::DEBUG::2014-09-09 09:55:20,937::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-13::DEBUG::2014-09-09 09:55:20,937::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-13::DEBUG::2014-09-09 09:55:20,937::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-13::DEBUG::2014-09-09 09:55:20,938::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /usr/sbin/iscsiadm -m session -R (cwd None) >Thread-13::DEBUG::2014-09-09 09:55:20,946::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-13::DEBUG::2014-09-09 09:55:20,946::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /usr/sbin/multipath (cwd None) >Thread-13::DEBUG::2014-09-09 09:55:20,965::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-09 09:55:20,965::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-09-09 09:55:20,965::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-09-09 09:55:20,966::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-09-09 09:55:20,966::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-09-09 09:55:20,966::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-09-09 09:55:20,966::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-09-09 09:55:20,966::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-13::INFO::2014-09-09 09:55:20,966::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '627a78ed-6123-4e11-a839-63b100459bc3'}, {'status': 0, 'id': 'b2429c9b-0750-46f1-a95a-ec0448e6435d'}]} >Thread-13::DEBUG::2014-09-09 09:55:20,966::task::1191::Storage.TaskManager.Task::(prepare) Task=`d38d7550-3bf7-4ad0-9702-668646e861a5`::finished: {'statuslist': [{'status': 0, 'id': '627a78ed-6123-4e11-a839-63b100459bc3'}, {'status': 0, 'id': 'b2429c9b-0750-46f1-a95a-ec0448e6435d'}]} >Thread-13::DEBUG::2014-09-09 09:55:20,966::task::595::Storage.TaskManager.Task::(_updateState) Task=`d38d7550-3bf7-4ad0-9702-668646e861a5`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-09-09 09:55:20,966::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-09-09 09:55:20,967::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-09-09 09:55:20,967::task::993::Storage.TaskManager.Task::(_decref) Task=`d38d7550-3bf7-4ad0-9702-668646e861a5`::ref 0 aborting False >Thread-13::DEBUG::2014-09-09 09:55:24,023::BindingXMLRPC::1132::vds::(wrapper) client [192.168.2.1]::call getCapabilities with () {} >Thread-13::DEBUG::2014-09-09 09:55:24,023::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-13::DEBUG::2014-09-09 09:55:24,029::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-09 09:55:24,041::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:df85635aad4d'}], 'FC': []}, 'packages2': {'kernel': {'release': '301.fc20.x86_64', 'buildtime': 1386270077.0, 'version': '3.11.10'}, 'spice-server': {'release': '2.fc20', 'buildtime': 1400513316L, 'version': '0.12.5'}, 'vdsm': {'release': '24.git16e82fe.fc20', 'buildtime': 1410269626L, 'version': '4.16.3'}, 'qemu-kvm': {'release': '1.fc20_rc3', 'buildtime': 1406666590L, 'version': '2.1.0'}, 'libvirt': {'release': '1.fc20', 'buildtime': 1407252230L, 'version': '1.2.8'}, 'qemu-img': {'release': '1.fc20_rc3', 'buildtime': 1406666590L, 'version': '2.1.0'}, 'mom': {'release': '1.fc20', 'buildtime': 1403118323L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz', 'liveMerge': 'true', 'hooks': {'before_vm_start': {'50_nestedvt': {'md5': '1eb86fc52cea5ee7812978176ce2d545'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '0'}, 'liveSnapshot': 'true', 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.2.100', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::fab1:56ff:fea8:7c34/64'], 'gateway': '192.168.2.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.2.100/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['em1']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.2.100', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::fab1:56ff:fea8:7c34/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.2.100/24'], 'ipv6gateway': '::', 'gateway': '192.168.2.1', 'opts': {'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '1000', 'group_fwd_mask': '0x0', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3125', 'hello_timer': '70', 'multicast_querier_interval': '25500', 'max_age': '2000', 'hash_max': '512', 'stp_state': '0', 'topology_change_detected': '0', 'priority': '32768', 'multicast_membership_interval': '26000', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', 'topology_change': '0', 'hello_time': '200', 'root_id': '8000.f8b156a87c34', 'bridge_id': '8000.f8b156a87c34', 'topology_change_timer': '0', 'ageing_time': '30000', 'nf_call_ip6tables': '0', 'gc_timer': '6789', 'nf_call_arptables': '0', 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', 'multicast_query_interval': '12500', 'multicast_query_use_ifaddr': '0', 'tcn_timer': '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': '0'}, 'ports': ['em1']}, 'virbr0': {'addr': '192.168.122.1', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'on', 'ipv4addrs': ['192.168.122.1/24'], 'ipv6gateway': '::', 'gateway': '', 'opts': {'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '1000', 'group_fwd_mask': '0x0', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3125', 'hello_timer': '172', 'multicast_querier_interval': '25500', 'max_age': '2000', 'hash_max': '512', 'stp_state': '1', 'topology_change_detected': '0', 'priority': '32768', 'multicast_membership_interval': '26000', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', 'topology_change': '0', 'hello_time': '200', 'root_id': '8000.000000000000', 'bridge_id': '8000.000000000000', 'topology_change_timer': '0', 'ageing_time': '30000', 'nf_call_ip6tables': '0', 'gc_timer': '952', 'nf_call_arptables': '0', 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', 'multicast_query_interval': '12500', 'multicast_query_use_ifaddr': '0', 'tcn_timer': '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': '200'}, 'ports': []}}, 'uuid': '4C4C4544-0043-5210-8039-C4C04F425A31', 'lastClientIface': 'ovirtmgmt', 'nics': {'em1': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': 'f8:b1:56:a8:7c:34', 'DEVICE': 'em1', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': 'f8:b1:56:a8:7c:34', 'speed': 100}}, 'software_revision': '24', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,nopl,xtopology,nonstop_tsc,aperfmperf,eagerfpu,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,sse4_1,sse4_2,x2apic,popcnt,tsc_deadline_timer,aes,xsave,avx,f16c,rdrand,lahf_lm,ida,arat,epb,xsaveopt,pln,pts,dtherm,tpr_shadow,vnmi,flexpriority,ept,vpid,fsgsbase,smep,erms,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:df85635aad4d', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '5e:94:b4:d2:15:37', 'slaves': [], 'opts': {}}}, 'software_version': '4.16', 'memSize': '15937', 'cpuSpeed': '1598.000', 'numaNodes': {u'0': {'totalMemory': '15937', 'cpus': [0, 1, 2, 3, 4, 5, 6, 7]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '8', 'emulatedMachines': [u'pc', u'pc-1.3', u'pc-0.12', u'pc-q35-1.6', u'pc-q35-1.5', u'xenpv', u'pc-i440fx-1.6', u'pc-i440fx-1.7', u'q35', u'pc-0.11', u'pc-0.10', u'pc-1.2', u'isapc', u'pc-q35-1.4', u'xenfv', u'pc-0.15', u'pc-i440fx-1.5', u'pc-i440fx-1.4', u'pc-q35-2.0', u'pc-0.14', u'pc-1.1', u'pc-q35-1.7', u'pc-1.0', u'pc-i440fx-2.0', u'pc-0.13'], 'rngSources': ['random'], 'operatingSystem': {'release': '3', 'version': '20', 'name': 'Fedora'}, 'lastClient': '192.168.2.1'}} >Thread-13::DEBUG::2014-09-09 09:55:24,055::BindingXMLRPC::1132::vds::(wrapper) client [192.168.2.1]::call getHardwareInfo with () {} >Thread-13::DEBUG::2014-09-09 09:55:24,055::BindingXMLRPC::1139::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'OptiPlex 7010', 'systemUUID': '4C4C4544-0043-5210-8039-C4C04F425A31', 'systemSerialNumber': 'DCR9BZ1', 'systemVersion': '01', 'systemManufacturer': 'Dell Inc.'}} >Thread-13::DEBUG::2014-09-09 09:55:24,166::BindingXMLRPC::318::vds::(wrapper) client [192.168.2.1] flowID [102efc39] >Thread-13::DEBUG::2014-09-09 09:55:24,166::task::595::Storage.TaskManager.Task::(_updateState) Task=`52371484-94cc-4ffa-8fc8-710a59d33fd1`::moving from state init -> state preparing >Thread-13::INFO::2014-09-09 09:55:24,166::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='5745e11d-81b4-4d82-8fed-c8a22ec23383', conList=[{'connection': '192.168.2.1:/home/storage/iso', 'iqn': '', 'user': '', 'tpgt': '1', 'password': '******', 'id': '627a78ed-6123-4e11-a839-63b100459bc3', 'port': ''}, {'connection': '192.168.2.1:/home/storage/data', 'iqn': '', 'user': '', 'tpgt': '1', 'password': '******', 'id': 'b2429c9b-0750-46f1-a95a-ec0448e6435d', 'port': ''}], options=None) >Thread-13::DEBUG::2014-09-09 09:55:24,167::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/192.168.2.1:_home_storage_iso >Thread-13::DEBUG::2014-09-09 09:55:24,168::mount::227::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /usr/bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 192.168.2.1:/home/storage/iso /rhev/data-center/mnt/192.168.2.1:_home_storage_iso (cwd None) >Thread-14::DEBUG::2014-09-09 09:55:24,195::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:24,195::__init__::225::IOProcess::(_processLogs) Message size is 118 >Thread-14::DEBUG::2014-09-09 09:55:24,195::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:24,195::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:24,195::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:24,196::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:24,196::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:24,196::__init__::225::IOProcess::(_processLogs) (59) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:55:24,196::__init__::225::IOProcess::(_processLogs) (59) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:55:24,196::__init__::225::IOProcess::(_processLogs) DEBUG|(59) Building response >Thread-14::DEBUG::2014-09-09 09:55:24,196::__init__::225::IOProcess::(_processLogs) (59) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:24,196::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-14::DEBUG::2014-09-09 09:55:24,197::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-13::DEBUG::2014-09-09 09:55:24,200::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.2.1:_home_storage_iso >Thread-14::DEBUG::2014-09-09 09:55:24,200::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:24,200::__init__::225::IOProcess::(_processLogs) Message size is 145 >Thread-14::DEBUG::2014-09-09 09:55:24,200::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:24,200::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:24,200::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:24,200::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:24,200::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:24,201::__init__::225::IOProcess::(_processLogs) (60) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-09 09:55:24,201::__init__::225::IOProcess::(_processLogs) (60) Got request for method 'glob' >Thread-14::DEBUG::2014-09-09 09:55:24,225::__init__::225::IOProcess::(_processLogs) DEBUG|(60) Building response >Thread-14::DEBUG::2014-09-09 09:55:24,225::__init__::225::IOProcess::(_processLogs) (60) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:24,225::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:24,225::__init__::225::IOProcess::(_processLogs) Sending response sized 142 >Thread-13::DEBUG::2014-09-09 09:55:24,226::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'e453999e-ec9f-420b-941c-a9f9cc4432bb',) >Thread-13::DEBUG::2014-09-09 09:55:24,226::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {e453999e-ec9f-420b-941c-a9f9cc4432bb: storage.nfsSD.findDomain, caf02237-e8a4-49fe-ab6d-4d23843f0edf: storage.nfsSD.findDomain} >Thread-13::DEBUG::2014-09-09 09:55:24,227::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/192.168.2.1:_home_storage_data >Thread-13::DEBUG::2014-09-09 09:55:24,227::mount::227::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /usr/bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 192.168.2.1:/home/storage/data /rhev/data-center/mnt/192.168.2.1:_home_storage_data (cwd None) >Thread-14::DEBUG::2014-09-09 09:55:24,250::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:24,250::__init__::225::IOProcess::(_processLogs) Message size is 119 >Thread-14::DEBUG::2014-09-09 09:55:24,250::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:24,250::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:24,250::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:24,250::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:24,250::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:24,250::__init__::225::IOProcess::(_processLogs) (61) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:55:24,250::__init__::225::IOProcess::(_processLogs) (61) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:55:24,251::__init__::225::IOProcess::(_processLogs) DEBUG|(61) Building response >Thread-14::DEBUG::2014-09-09 09:55:24,251::__init__::225::IOProcess::(_processLogs) (61) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:24,251::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:24,251::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-13::DEBUG::2014-09-09 09:55:24,254::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.2.1:_home_storage_data >Thread-14::DEBUG::2014-09-09 09:55:24,254::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:24,254::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-09 09:55:24,254::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:24,255::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:24,255::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:24,255::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:24,255::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:24,255::__init__::225::IOProcess::(_processLogs) (62) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-09 09:55:24,255::__init__::225::IOProcess::(_processLogs) (62) Got request for method 'glob' >Thread-14::DEBUG::2014-09-09 09:55:24,256::__init__::225::IOProcess::(_processLogs) DEBUG|(62) Building response >Thread-14::DEBUG::2014-09-09 09:55:24,256::__init__::225::IOProcess::(_processLogs) (62) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:24,256::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:24,256::__init__::225::IOProcess::(_processLogs) Sending response sized 143 >Thread-13::DEBUG::2014-09-09 09:55:24,257::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'caf02237-e8a4-49fe-ab6d-4d23843f0edf',) >Thread-13::DEBUG::2014-09-09 09:55:24,257::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {e453999e-ec9f-420b-941c-a9f9cc4432bb: storage.nfsSD.findDomain, caf02237-e8a4-49fe-ab6d-4d23843f0edf: storage.nfsSD.findDomain} >Thread-13::INFO::2014-09-09 09:55:24,257::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '627a78ed-6123-4e11-a839-63b100459bc3'}, {'status': 0, 'id': 'b2429c9b-0750-46f1-a95a-ec0448e6435d'}]} >Thread-13::DEBUG::2014-09-09 09:55:24,257::task::1191::Storage.TaskManager.Task::(prepare) Task=`52371484-94cc-4ffa-8fc8-710a59d33fd1`::finished: {'statuslist': [{'status': 0, 'id': '627a78ed-6123-4e11-a839-63b100459bc3'}, {'status': 0, 'id': 'b2429c9b-0750-46f1-a95a-ec0448e6435d'}]} >Thread-13::DEBUG::2014-09-09 09:55:24,257::task::595::Storage.TaskManager.Task::(_updateState) Task=`52371484-94cc-4ffa-8fc8-710a59d33fd1`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-09-09 09:55:24,257::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-09-09 09:55:24,257::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-09-09 09:55:24,257::task::993::Storage.TaskManager.Task::(_decref) Task=`52371484-94cc-4ffa-8fc8-710a59d33fd1`::ref 0 aborting False >Thread-13::DEBUG::2014-09-09 09:55:24,269::BindingXMLRPC::318::vds::(wrapper) client [192.168.2.1] >Thread-13::DEBUG::2014-09-09 09:55:24,269::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd9177a3-1d28-461e-ac08-7dfd710407d1`::moving from state init -> state preparing >Thread-13::INFO::2014-09-09 09:55:24,270::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='5745e11d-81b4-4d82-8fed-c8a22ec23383', hostID=2, msdUUID='caf02237-e8a4-49fe-ab6d-4d23843f0edf', masterVersion=1, domainsMap={'e453999e-ec9f-420b-941c-a9f9cc4432bb': 'active', 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': 'active'}, options=None) >Thread-13::DEBUG::2014-09-09 09:55:24,270::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`ab4be769-900e-4f74-9576-01fda4c40267`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1011' at 'connectStoragePool' >Thread-13::DEBUG::2014-09-09 09:55:24,270::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-13::DEBUG::2014-09-09 09:55:24,270::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-13::DEBUG::2014-09-09 09:55:24,270::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`ab4be769-900e-4f74-9576-01fda4c40267`::Granted request >Thread-13::DEBUG::2014-09-09 09:55:24,270::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ca35a143-28de-4f7b-a08f-8aea425d6d80`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1059' at '_connectStoragePool' >Thread-13::DEBUG::2014-09-09 09:55:24,271::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'exclusive' >Thread-13::DEBUG::2014-09-09 09:55:24,271::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'exclusive' (1 active user) >Thread-13::DEBUG::2014-09-09 09:55:24,271::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ca35a143-28de-4f7b-a08f-8aea425d6d80`::Granted request >Thread-13::DEBUG::2014-09-09 09:55:24,271::spbackends::485::Storage.StoragePoolMemoryBackend::(updateVersionAndDomains) updating domain version to 1 and domains map to {'e453999e-ec9f-420b-941c-a9f9cc4432bb': 'active', 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': 'active'} >Thread-13::INFO::2014-09-09 09:55:24,271::spbackends::433::Storage.StoragePoolMemoryBackend::(setDomainsMap) new storage pool master version 1 and domains map {'e453999e-ec9f-420b-941c-a9f9cc4432bb': 'Active', 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': 'Active'} >Thread-13::INFO::2014-09-09 09:55:24,271::sp::133::Storage.StoragePool::(setBackend) updating pool 5745e11d-81b4-4d82-8fed-c8a22ec23383 backend from type NoneType instance 0x36c478ff00 to type StoragePoolMemoryBackend instance 0x7f41744115d0 >Thread-13::INFO::2014-09-09 09:55:24,271::sp::631::Storage.StoragePool::(connect) Connect host #2 to the storage pool 5745e11d-81b4-4d82-8fed-c8a22ec23383 with master domain: caf02237-e8a4-49fe-ab6d-4d23843f0edf (ver = 1) >Thread-13::DEBUG::2014-09-09 09:55:24,271::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-09-09 09:55:24,271::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-09-09 09:55:24,272::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-09-09 09:55:24,272::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-09-09 09:55:24,272::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-09-09 09:55:24,272::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-09-09 09:55:24,272::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-13::DEBUG::2014-09-09 09:55:24,272::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-13::DEBUG::2014-09-09 09:55:24,272::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-13::DEBUG::2014-09-09 09:55:24,272::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-13::DEBUG::2014-09-09 09:55:24,272::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-13::DEBUG::2014-09-09 09:55:24,272::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /usr/sbin/iscsiadm -m session -R (cwd None) >Thread-13::DEBUG::2014-09-09 09:55:24,280::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-13::DEBUG::2014-09-09 09:55:24,281::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /usr/sbin/multipath (cwd None) >Thread-13::DEBUG::2014-09-09 09:55:24,296::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-09 09:55:24,296::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-09-09 09:55:24,296::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-09-09 09:55:24,296::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-09-09 09:55:24,296::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-09-09 09:55:24,296::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-09-09 09:55:24,296::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-09-09 09:55:24,297::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-14::DEBUG::2014-09-09 09:55:24,298::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:24,298::__init__::225::IOProcess::(_processLogs) Message size is 126 >Thread-14::DEBUG::2014-09-09 09:55:24,298::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:24,298::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:24,299::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:24,299::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:24,299::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:24,299::__init__::225::IOProcess::(_processLogs) (63) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-09 09:55:24,299::__init__::225::IOProcess::(_processLogs) (63) Got request for method 'glob' >Thread-14::DEBUG::2014-09-09 09:55:24,299::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:24,299::__init__::225::IOProcess::(_processLogs) Message size is 125 >Thread-14::DEBUG::2014-09-09 09:55:24,299::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:24,299::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:24,299::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:24,299::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:24,300::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:24,300::__init__::225::IOProcess::(_processLogs) (64) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-09 09:55:24,300::__init__::225::IOProcess::(_processLogs) (64) Got request for method 'glob' >Thread-14::DEBUG::2014-09-09 09:55:24,300::__init__::225::IOProcess::(_processLogs) DEBUG|(63) Building response >Thread-14::DEBUG::2014-09-09 09:55:24,300::__init__::225::IOProcess::(_processLogs) (63) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:24,300::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-14::DEBUG::2014-09-09 09:55:24,301::__init__::225::IOProcess::(_processLogs) Sending response sized 150 >Thread-14::DEBUG::2014-09-09 09:55:24,301::__init__::225::IOProcess::(_processLogs) DEBUG|(64) Building response >Thread-14::DEBUG::2014-09-09 09:55:24,301::__init__::225::IOProcess::(_processLogs) DEBUG|(64) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:24,302::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:24,303::__init__::225::IOProcess::(_processLogs) Sending response sized 149 >Thread-13::DEBUG::2014-09-09 09:55:24,304::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-14::DEBUG::2014-09-09 09:55:24,305::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:24,305::__init__::225::IOProcess::(_processLogs) Message size is 155 >Thread-14::DEBUG::2014-09-09 09:55:24,305::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:24,305::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:24,305::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:24,305::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:24,305::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:24,305::__init__::225::IOProcess::(_processLogs) (65) Finding callback 'touch'... >Thread-14::DEBUG::2014-09-09 09:55:24,305::__init__::225::IOProcess::(_processLogs) (65) Got request for method 'touch' >Thread-14::DEBUG::2014-09-09 09:55:24,339::__init__::225::IOProcess::(_processLogs) DEBUG|(65) Building response >Thread-14::DEBUG::2014-09-09 09:55:24,339::__init__::225::IOProcess::(_processLogs) (65) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:24,339::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:24,339::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 54 >Thread-13::DEBUG::2014-09-09 09:55:24,339::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-14::DEBUG::2014-09-09 09:55:24,340::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:24,340::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-14::DEBUG::2014-09-09 09:55:24,340::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:24,340::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:24,340::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:24,340::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:24,340::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:24,340::__init__::225::IOProcess::(_processLogs) (66) Finding callback 'readfile'... >Thread-14::DEBUG::2014-09-09 09:55:24,341::__init__::225::IOProcess::(_processLogs) (66) Got request for method 'readfile' >Thread-14::DEBUG::2014-09-09 09:55:24,344::__init__::225::IOProcess::(_processLogs) DEBUG|(66) Building response >Thread-14::DEBUG::2014-09-09 09:55:24,344::__init__::225::IOProcess::(_processLogs) (66) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:24,344::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-13::DEBUG::2014-09-09 09:55:24,344::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfs', 'POOL_DOMAINS=e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data', 'ROLE=Master', 'SDUUID=caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=7da2e8f9278d86580da94a5d696e58b6fafaae7b'] >Thread-14::DEBUG::2014-09-09 09:55:24,345::__init__::225::IOProcess::(_processLogs) Sending response sized 728 >Thread-14::DEBUG::2014-09-09 09:55:24,345::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:24,346::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-14::DEBUG::2014-09-09 09:55:24,346::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:24,346::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:24,346::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:24,346::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:24,346::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:24,346::__init__::225::IOProcess::(_processLogs) (67) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:55:24,346::__init__::225::IOProcess::(_processLogs) (67) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:55:24,347::__init__::225::IOProcess::(_processLogs) (67) Building response >Thread-14::DEBUG::2014-09-09 09:55:24,347::__init__::225::IOProcess::(_processLogs) (67) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:24,347::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:24,347::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-14::DEBUG::2014-09-09 09:55:24,347::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:24,347::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-09 09:55:24,347::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:24,347::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:24,347::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:24,347::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:24,347::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:24,347::__init__::225::IOProcess::(_processLogs) (68) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-09 09:55:24,348::__init__::225::IOProcess::(_processLogs) (68) Got request for method 'glob' >Thread-14::DEBUG::2014-09-09 09:55:24,350::__init__::225::IOProcess::(_processLogs) DEBUG|(68) Building response >Thread-14::DEBUG::2014-09-09 09:55:24,350::__init__::225::IOProcess::(_processLogs) DEBUG|(68) Queuing response >Thread-13::DEBUG::2014-09-09 09:55:24,350::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-14::DEBUG::2014-09-09 09:55:24,350::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-13::INFO::2014-09-09 09:55:24,350::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS already registered >Thread-13::INFO::2014-09-09 09:55:24,351::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS already registered >Thread-14::DEBUG::2014-09-09 09:55:24,351::__init__::225::IOProcess::(_processLogs) Sending response sized 52 >Thread-13::DEBUG::2014-09-09 09:55:24,352::sp::1390::Storage.StoragePool::(setMasterDomain) Master domain caf02237-e8a4-49fe-ab6d-4d23843f0edf verified, version 1 >Thread-13::DEBUG::2014-09-09 09:55:24,352::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-13::DEBUG::2014-09-09 09:55:24,352::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-13::INFO::2014-09-09 09:55:24,352::domainMonitor::100::Storage.DomainMonitor::(startMonitoring) Start monitoring e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-35::DEBUG::2014-09-09 09:55:24,352::domainMonitor::182::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-13::DEBUG::2014-09-09 09:55:24,352::sp::1413::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `5745e11d-81b4-4d82-8fed-c8a22ec23383` started monitoring domain `e453999e-ec9f-420b-941c-a9f9cc4432bb` >Thread-13::INFO::2014-09-09 09:55:24,353::domainMonitor::100::Storage.DomainMonitor::(startMonitoring) Start monitoring caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-13::DEBUG::2014-09-09 09:55:24,354::sp::1413::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `5745e11d-81b4-4d82-8fed-c8a22ec23383` started monitoring domain `caf02237-e8a4-49fe-ab6d-4d23843f0edf` >Thread-37::DEBUG::2014-09-09 09:55:24,355::domainMonitor::182::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-14::DEBUG::2014-09-09 09:55:24,355::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-13::DEBUG::2014-09-09 09:55:24,355::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-13::DEBUG::2014-09-09 09:55:24,356::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383 >Thread-14::DEBUG::2014-09-09 09:55:24,356::__init__::225::IOProcess::(_processLogs) Message size is 126 >Thread-14::DEBUG::2014-09-09 09:55:24,357::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-13::DEBUG::2014-09-09 09:55:24,357::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-09-09 09:55:24,357::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:24,358::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:24,358::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-13::DEBUG::2014-09-09 09:55:24,359::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e453999e-ec9f-420b-941c-a9f9cc4432bb (cwd None) >Thread-14::DEBUG::2014-09-09 09:55:24,359::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:24,363::__init__::225::IOProcess::(_processLogs) (69) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-09 09:55:24,363::__init__::225::IOProcess::(_processLogs) (69) Got request for method 'glob' >Thread-14::DEBUG::2014-09-09 09:55:24,363::__init__::225::IOProcess::(_processLogs) DEBUG|(69) Building response >Thread-14::DEBUG::2014-09-09 09:55:24,364::__init__::225::IOProcess::(_processLogs) (69) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:24,364::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:24,364::__init__::225::IOProcess::(_processLogs) Sending response sized 150 >Thread-14::DEBUG::2014-09-09 09:55:24,364::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:24,364::__init__::225::IOProcess::(_processLogs) Message size is 125 >Thread-14::DEBUG::2014-09-09 09:55:24,364::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:24,364::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:24,365::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:24,365::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:24,365::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:24,365::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-09 09:55:24,365::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:24,365::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:24,365::__init__::225::IOProcess::(_processLogs) (70) Finding callback 'glob'...DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:24,365::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:24,365::__init__::225::IOProcess::(_processLogs) (71) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:55:24,365::__init__::225::IOProcess::(_processLogs) (71) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:55:24,366::__init__::225::IOProcess::(_processLogs) DEBUG|(70) Building response >Thread-14::DEBUG::2014-09-09 09:55:24,366::__init__::225::IOProcess::(_processLogs) (70) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:24,367::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:24,367::__init__::225::IOProcess::(_processLogs) Sending response sized 149 >Thread-14::DEBUG::2014-09-09 09:55:24,368::__init__::225::IOProcess::(_processLogs) (71) Building response >Thread-14::DEBUG::2014-09-09 09:55:24,369::__init__::225::IOProcess::(_processLogs) (71) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:24,369::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:24,370::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-35::DEBUG::2014-09-09 09:55:24,372::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-37::DEBUG::2014-09-09 09:55:24,372::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-09 09:55:24,373::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:24,377::__init__::225::IOProcess::(_processLogs) Message size is 154 >Thread-14::DEBUG::2014-09-09 09:55:24,377::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:24,377::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:24,377::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:24,377::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:24,377::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:24,378::__init__::225::IOProcess::(_processLogs) (72) Finding callback 'touch'... >Thread-14::DEBUG::2014-09-09 09:55:24,378::__init__::225::IOProcess::(_processLogs) (72) Got request for method 'touch' >Thread-37::DEBUG::2014-09-09 09:55:24,378::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n505 bytes (505 B) copied, 0.000929266 s, 543 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-09 09:55:24,379::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-13::DEBUG::2014-09-09 09:55:24,379::lvm::288::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n Volume group "e453999e-ec9f-420b-941c-a9f9cc4432bb" not found\n Skipping volume group e453999e-ec9f-420b-941c-a9f9cc4432bb\n'; <rc> = 5 >Thread-14::DEBUG::2014-09-09 09:55:24,380::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-09 09:55:24,380::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:24,381::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:24,381::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-13::WARNING::2014-09-09 09:55:24,381::lvm::370::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!', ' Volume group "e453999e-ec9f-420b-941c-a9f9cc4432bb" not found', ' Skipping volume group e453999e-ec9f-420b-941c-a9f9cc4432bb'] >Thread-14::DEBUG::2014-09-09 09:55:24,382::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-13::DEBUG::2014-09-09 09:55:24,382::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-09-09 09:55:24,382::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:24,383::__init__::225::IOProcess::(_processLogs) (73) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:55:24,385::__init__::225::IOProcess::(_processLogs) DEBUG|(73) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:55:24,385::__init__::225::IOProcess::(_processLogs) (73) Building response >Thread-14::DEBUG::2014-09-09 09:55:24,385::__init__::225::IOProcess::(_processLogs) (73) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:24,385::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:24,385::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-14::DEBUG::2014-09-09 09:55:24,385::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:24,385::__init__::225::IOProcess::(_processLogs) Message size is 126 >Thread-14::DEBUG::2014-09-09 09:55:24,386::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:24,386::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:24,386::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:24,386::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:24,386::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:24,386::__init__::225::IOProcess::(_processLogs) (74) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-09 09:55:24,386::__init__::225::IOProcess::(_processLogs) (74) Got request for method 'glob' >Thread-14::DEBUG::2014-09-09 09:55:24,386::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:24,387::__init__::225::IOProcess::(_processLogs) Message size is 125 >Thread-14::DEBUG::2014-09-09 09:55:24,387::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:24,387::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:24,387::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:24,387::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:24,387::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:24,387::__init__::225::IOProcess::(_processLogs) (75) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-09 09:55:24,387::__init__::225::IOProcess::(_processLogs) (75) Got request for method 'glob' >Thread-14::DEBUG::2014-09-09 09:55:24,387::__init__::225::IOProcess::(_processLogs) (74) Building response >Thread-14::DEBUG::2014-09-09 09:55:24,387::__init__::225::IOProcess::(_processLogs) (74) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:24,388::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:24,388::__init__::225::IOProcess::(_processLogs) Sending response sized 150 >Thread-14::DEBUG::2014-09-09 09:55:24,388::__init__::225::IOProcess::(_processLogs) DEBUG|(75) Building response >Thread-13::INFO::2014-09-09 09:55:24,388::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb to /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-14::DEBUG::2014-09-09 09:55:24,389::__init__::225::IOProcess::(_processLogs) (75) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:24,389::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-13::DEBUG::2014-09-09 09:55:24,389::sp::1137::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb to /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-14::DEBUG::2014-09-09 09:55:24,390::__init__::225::IOProcess::(_processLogs) Sending response sized 149 >Thread-13::INFO::2014-09-09 09:55:24,390::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf to /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-14::DEBUG::2014-09-09 09:55:24,390::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-13::DEBUG::2014-09-09 09:55:24,390::sp::1137::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf to /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-14::DEBUG::2014-09-09 09:55:24,391::__init__::225::IOProcess::(_processLogs) Message size is 163 >Thread-13::INFO::2014-09-09 09:55:24,391::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf to /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd >Thread-14::DEBUG::2014-09-09 09:55:24,391::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:24,392::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-13::DEBUG::2014-09-09 09:55:24,392::sp::1137::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf to /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd >Thread-14::DEBUG::2014-09-09 09:55:24,392::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:24,393::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:24,393::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:24,393::__init__::225::IOProcess::(_processLogs) (76) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:55:24,393::__init__::225::IOProcess::(_processLogs) (76) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:55:24,393::__init__::225::IOProcess::(_processLogs) DEBUG|(72) Building response >Thread-35::DEBUG::2014-09-09 09:55:24,393::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-14::DEBUG::2014-09-09 09:55:24,394::__init__::225::IOProcess::(_processLogs) (72) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:24,394::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:24,394::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-13::DEBUG::2014-09-09 09:55:24,395::threadPool::35::Storage.ThreadPool::(__init__) Enter - numThreads: 5, waitTimeout: 3, maxTasks: 500 >Thread-14::DEBUG::2014-09-09 09:55:24,395::__init__::225::IOProcess::(_processLogs) (76) Building response >Thread-14::DEBUG::2014-09-09 09:55:24,396::__init__::225::IOProcess::(_processLogs) (76) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:24,397::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:24,398::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-13::DEBUG::2014-09-09 09:55:24,398::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) /usr/bin/dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=16 (cwd None) >Thread-14::DEBUG::2014-09-09 09:55:24,403::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:24,403::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-14::DEBUG::2014-09-09 09:55:24,403::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:24,403::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:24,403::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:24,403::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:24,403::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:24,404::__init__::225::IOProcess::(_processLogs) (77) Finding callback 'readfile'... >Thread-14::DEBUG::2014-09-09 09:55:24,404::__init__::225::IOProcess::(_processLogs) (77) Got request for method 'readfile' >Thread-14::DEBUG::2014-09-09 09:55:24,404::__init__::225::IOProcess::(_processLogs) DEBUG|(77) Building response >Thread-35::DEBUG::2014-09-09 09:55:24,404::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=iso', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=00000002-0002-0002-0002-000000000047,6d2495f3-efe4-4aa1-ab93-bdb0f6860cee,ff41f65c-09ac-40aa-8917-4b3ca8719aec,a69c4d84-3114-4937-aace-2079ce66b10b,7b90a9ec-ecb3-4105-b817-306ffc0b8245,be744655-2a19-4919-92f3-e7c20ac03193,0650ae6a-530a-4208-a13a-668025352382,528420e2-28d3-42c0-a243-a72c2dc0bd04,5fa7190c-833d-4b62-8524-a114f6ce5a79,4ed9221c-909e-4b58-998d-6140b9c241d0,00000002-0002-0002-0002-00000000034b,ca74573b-dc89-4785-92a8-5fdcc079f4df,00000002-0002-0002-0002-0000000001e1,aab45993-c5cf-436e-b55a-873bd83681d2,1ac20b5a-4433-4c04-bbc7-33d7eb3fd41f,d0089906-9093-4e45-91f4-2c73256f3dd3,9d8913f8-c9ee-4216-b161-a9ead1047fb9,f201c1d3-166d-42b0-ab69-0920a6dc279f,a1d01b58-6574-432d-b2df-2054ffca7eab,25a09b8a-177c-40af-865d-22436da5cc66,aed40d3c-15fc-45d2-bcba-da1398ae3d14,5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/iso', 'ROLE=Regular', 'SDUUID=e453999e-ec9f-420b-941c-a9f9cc4432bb', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=3ab7cad61661fbee975ab14bc6a1ca5540004e85'] >Thread-14::DEBUG::2014-09-09 09:55:24,405::__init__::225::IOProcess::(_processLogs) (77) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:24,406::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:24,406::__init__::225::IOProcess::(_processLogs) Sending response sized 1552 >Thread-14::DEBUG::2014-09-09 09:55:24,406::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:24,406::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-14::DEBUG::2014-09-09 09:55:24,406::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:24,406::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:24,406::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:24,406::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:24,406::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:24,406::__init__::225::IOProcess::(_processLogs) (78) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:55:24,406::__init__::225::IOProcess::(_processLogs) (78) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:55:24,407::__init__::225::IOProcess::(_processLogs) DEBUG|(78) Building response >Thread-14::DEBUG::2014-09-09 09:55:24,407::__init__::225::IOProcess::(_processLogs) (78) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:24,407::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:24,407::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-14::DEBUG::2014-09-09 09:55:24,407::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:24,407::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-14::DEBUG::2014-09-09 09:55:24,407::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:24,408::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:24,408::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:24,408::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:24,408::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:24,408::__init__::225::IOProcess::(_processLogs) (79) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:55:24,408::__init__::225::IOProcess::(_processLogs) (79) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:55:24,408::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:24,408::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-14::DEBUG::2014-09-09 09:55:24,409::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:24,409::__init__::225::IOProcess::(_processLogs) (79) Building response >Thread-14::DEBUG::2014-09-09 09:55:24,409::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:24,409::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:24,409::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:24,409::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:24,409::__init__::225::IOProcess::(_processLogs) (80) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:55:24,409::__init__::225::IOProcess::(_processLogs) (80) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:55:24,409::__init__::225::IOProcess::(_processLogs) (80) Queuing response >Thread-37::DEBUG::2014-09-09 09:55:24,410::domainMonitor::264::Storage.DomainMonitorThread::(_monitorDomain) Domain caf02237-e8a4-49fe-ab6d-4d23843f0edf changed its status to Valid >Thread-14::DEBUG::2014-09-09 09:55:24,410::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-46::DEBUG::2014-09-09 09:55:24,412::misc::821::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-14::DEBUG::2014-09-09 09:55:24,412::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-13::DEBUG::2014-09-09 09:55:24,412::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00647272 s, 633 kB/s\n'; <rc> = 0 >Thread-46::DEBUG::2014-09-09 09:55:24,412::misc::831::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms` >Thread-13::INFO::2014-09-09 09:55:24,413::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/usr/bin/dd', 'of=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=16'] >Thread-14::DEBUG::2014-09-09 09:55:24,413::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-46::DEBUG::2014-09-09 09:55:24,414::misc::841::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Thread-47::INFO::2014-09-09 09:55:24,415::clientIF::136::vds::(contEIOVms) vmContainerLock acquired >Thread-14::DEBUG::2014-09-09 09:55:24,415::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-13::DEBUG::2014-09-09 09:55:24,415::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) /usr/bin/dd of=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=16 (cwd None) >Thread-14::DEBUG::2014-09-09 09:55:24,416::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:24,420::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:24,420::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:24,420::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:24,420::__init__::225::IOProcess::(_processLogs) (81) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-09 09:55:24,421::__init__::225::IOProcess::(_processLogs) (81) Got request for method 'glob' >Thread-35::DEBUG::2014-09-09 09:55:24,429::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-35::INFO::2014-09-09 09:55:24,429::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_imageNS already registered >Thread-35::INFO::2014-09-09 09:55:24,429::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_volumeNS already registered >Thread-14::DEBUG::2014-09-09 09:55:24,430::__init__::225::IOProcess::(_processLogs) Message size is 145 >Thread-14::DEBUG::2014-09-09 09:55:24,430::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:24,430::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:24,430::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:24,430::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:24,430::__init__::225::IOProcess::(_processLogs) (82) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:55:24,430::__init__::225::IOProcess::(_processLogs) (82) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:55:24,431::__init__::225::IOProcess::(_processLogs) (82) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:24,431::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-35::DEBUG::2014-09-09 09:55:24,431::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-09 09:55:24,431::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-35::DEBUG::2014-09-09 09:55:24,437::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00107358 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-09 09:55:24,438::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:24,438::__init__::225::IOProcess::(_processLogs) Message size is 145 >Thread-14::DEBUG::2014-09-09 09:55:24,438::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:24,438::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:24,438::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:24,438::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:24,438::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:24,438::__init__::225::IOProcess::(_processLogs) (83) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:55:24,438::__init__::225::IOProcess::(_processLogs) (83) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:55:24,438::__init__::225::IOProcess::(_processLogs) DEBUG|(83) Building response >Thread-14::DEBUG::2014-09-09 09:55:24,439::__init__::225::IOProcess::(_processLogs) (83) Queuing response >Thread-35::DEBUG::2014-09-09 09:55:24,439::domainMonitor::264::Storage.DomainMonitorThread::(_monitorDomain) Domain e453999e-ec9f-420b-941c-a9f9cc4432bb changed its status to Valid >Thread-14::DEBUG::2014-09-09 09:55:24,439::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-48::DEBUG::2014-09-09 09:55:24,440::misc::821::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-14::DEBUG::2014-09-09 09:55:24,440::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-48::DEBUG::2014-09-09 09:55:24,441::misc::831::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms` >Thread-48::DEBUG::2014-09-09 09:55:24,441::misc::841::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Thread-49::INFO::2014-09-09 09:55:24,441::clientIF::136::vds::(contEIOVms) vmContainerLock acquired >Thread-13::DEBUG::2014-09-09 09:55:24,715::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.293497 s, 14.0 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-09-09 09:55:24,715::storage_mailbox::207::Storage.Mailbox.HSM::(__init__) HSM_MailboxMonitor created for pool 5745e11d-81b4-4d82-8fed-c8a22ec23383 >Thread-13::DEBUG::2014-09-09 09:55:24,716::sp::462::Storage.StoragePool::(__createMailboxMonitor) HSM mailbox ready for pool 5745e11d-81b4-4d82-8fed-c8a22ec23383 on master domain caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-13::DEBUG::2014-09-09 09:55:24,716::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-13::DEBUG::2014-09-09 09:55:24,716::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-13::DEBUG::2014-09-09 09:55:24,716::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-13::DEBUG::2014-09-09 09:55:24,716::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-13::DEBUG::2014-09-09 09:55:24,716::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-13::DEBUG::2014-09-09 09:55:24,716::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-13::DEBUG::2014-09-09 09:55:24,716::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-13::DEBUG::2014-09-09 09:55:24,716::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-13::INFO::2014-09-09 09:55:24,717::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-13::DEBUG::2014-09-09 09:55:24,717::task::1191::Storage.TaskManager.Task::(prepare) Task=`dd9177a3-1d28-461e-ac08-7dfd710407d1`::finished: True >Thread-13::DEBUG::2014-09-09 09:55:24,717::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd9177a3-1d28-461e-ac08-7dfd710407d1`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-09-09 09:55:24,717::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-09-09 09:55:24,717::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-09-09 09:55:24,717::task::993::Storage.TaskManager.Task::(_decref) Task=`dd9177a3-1d28-461e-ac08-7dfd710407d1`::ref 0 aborting False >Thread-13::DEBUG::2014-09-09 09:55:24,724::task::595::Storage.TaskManager.Task::(_updateState) Task=`de1f39af-1e17-4b04-aac0-cf9b00ad1382`::moving from state init -> state preparing >Thread-13::INFO::2014-09-09 09:55:24,724::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-09-09 09:55:24,725::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107358', 'lastCheck': '0.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000929266', 'lastCheck': '0.3', 'valid': True}} >Thread-13::DEBUG::2014-09-09 09:55:24,725::task::1191::Storage.TaskManager.Task::(prepare) Task=`de1f39af-1e17-4b04-aac0-cf9b00ad1382`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107358', 'lastCheck': '0.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000929266', 'lastCheck': '0.3', 'valid': True}} >Thread-13::DEBUG::2014-09-09 09:55:24,725::task::595::Storage.TaskManager.Task::(_updateState) Task=`de1f39af-1e17-4b04-aac0-cf9b00ad1382`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-09-09 09:55:24,725::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-09-09 09:55:24,725::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-09-09 09:55:24,725::task::993::Storage.TaskManager.Task::(_decref) Task=`de1f39af-1e17-4b04-aac0-cf9b00ad1382`::ref 0 aborting False >Thread-13::DEBUG::2014-09-09 09:55:24,758::BindingXMLRPC::1132::vds::(wrapper) client [192.168.2.1]::call setMOMPolicyParameters with ({'balloonEnabled': False, 'ksmEnabled': False},) {} flowID [102efc39] >Thread-13::DEBUG::2014-09-09 09:55:24,804::BindingXMLRPC::1139::vds::(wrapper) return setMOMPolicyParameters with {'status': {'message': 'Done', 'code': 0}} >Thread-13::DEBUG::2014-09-09 09:55:30,886::task::595::Storage.TaskManager.Task::(_updateState) Task=`196f4daa-8daf-4335-adb9-8d474880af60`::moving from state init -> state preparing >Thread-13::INFO::2014-09-09 09:55:30,887::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-09-09 09:55:30,887::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107358', 'lastCheck': '6.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000929266', 'lastCheck': '6.5', 'valid': True}} >Thread-13::DEBUG::2014-09-09 09:55:30,887::task::1191::Storage.TaskManager.Task::(prepare) Task=`196f4daa-8daf-4335-adb9-8d474880af60`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107358', 'lastCheck': '6.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000929266', 'lastCheck': '6.5', 'valid': True}} >Thread-13::DEBUG::2014-09-09 09:55:30,887::task::595::Storage.TaskManager.Task::(_updateState) Task=`196f4daa-8daf-4335-adb9-8d474880af60`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-09-09 09:55:30,887::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-09-09 09:55:30,887::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-09-09 09:55:30,887::task::993::Storage.TaskManager.Task::(_decref) Task=`196f4daa-8daf-4335-adb9-8d474880af60`::ref 0 aborting False >Thread-14::DEBUG::2014-09-09 09:55:34,412::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-09 09:55:34,412::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:34,412::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:34,412::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:34,412::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:34,413::__init__::225::IOProcess::(_processLogs) (84) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:55:34,413::__init__::225::IOProcess::(_processLogs) (84) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:55:34,413::__init__::225::IOProcess::(_processLogs) (84) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:34,413::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:34,413::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-37::DEBUG::2014-09-09 09:55:34,414::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-09-09 09:55:34,421::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n504 bytes (504 B) copied, 0.00102078 s, 494 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-09 09:55:34,422::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-09 09:55:34,422::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:34,422::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:34,422::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:34,422::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:34,422::__init__::225::IOProcess::(_processLogs) (85) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:55:34,422::__init__::225::IOProcess::(_processLogs) (85) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:55:34,423::__init__::225::IOProcess::(_processLogs) (85) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:34,423::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:34,423::__init__::225::IOProcess::(_processLogs) Message size is 163 >Thread-14::DEBUG::2014-09-09 09:55:34,424::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:34,424::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:34,424::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:34,424::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:34,424::__init__::225::IOProcess::(_processLogs) (86) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:55:34,424::__init__::225::IOProcess::(_processLogs) (86) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:55:34,424::__init__::225::IOProcess::(_processLogs) (86) Building response >Thread-14::DEBUG::2014-09-09 09:55:34,425::__init__::225::IOProcess::(_processLogs) (86) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:34,425::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:34,425::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-14::DEBUG::2014-09-09 09:55:34,425::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-14::DEBUG::2014-09-09 09:55:34,425::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:34,425::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:34,425::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:34,425::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:34,426::__init__::225::IOProcess::(_processLogs) (87) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:55:34,426::__init__::225::IOProcess::(_processLogs) (87) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:55:34,426::__init__::225::IOProcess::(_processLogs) (87) Building response >Thread-14::DEBUG::2014-09-09 09:55:34,426::__init__::225::IOProcess::(_processLogs) (87) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:34,426::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:34,426::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-14::DEBUG::2014-09-09 09:55:34,426::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-14::DEBUG::2014-09-09 09:55:34,426::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:34,427::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:34,427::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:34,427::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:34,427::__init__::225::IOProcess::(_processLogs) (88) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:55:34,427::__init__::225::IOProcess::(_processLogs) (88) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:55:34,427::__init__::225::IOProcess::(_processLogs) (88) Building response >Thread-14::DEBUG::2014-09-09 09:55:34,427::__init__::225::IOProcess::(_processLogs) (88) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:34,427::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:34,427::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-14::DEBUG::2014-09-09 09:55:34,440::__init__::225::IOProcess::(_processLogs) Message size is 145 >Thread-14::DEBUG::2014-09-09 09:55:34,441::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:34,441::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:34,441::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:34,441::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:34,441::__init__::225::IOProcess::(_processLogs) (89) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:55:34,441::__init__::225::IOProcess::(_processLogs) (89) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:55:34,441::__init__::225::IOProcess::(_processLogs) (89) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:34,441::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:34,442::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-35::DEBUG::2014-09-09 09:55:34,442::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-35::DEBUG::2014-09-09 09:55:34,449::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0012221 s, 919 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-09 09:55:34,449::__init__::225::IOProcess::(_processLogs) Message size is 145 >Thread-14::DEBUG::2014-09-09 09:55:34,449::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:34,449::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:34,450::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:34,450::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:34,450::__init__::225::IOProcess::(_processLogs) (90) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:55:34,450::__init__::225::IOProcess::(_processLogs) (90) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:55:34,450::__init__::225::IOProcess::(_processLogs) (90) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:34,450::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:34,451::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-14::DEBUG::2014-09-09 09:55:44,427::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-09 09:55:44,427::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:44,427::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:44,427::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:44,428::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:44,428::__init__::225::IOProcess::(_processLogs) (91) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:55:44,428::__init__::225::IOProcess::(_processLogs) (91) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:55:44,428::__init__::225::IOProcess::(_processLogs) (91) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:44,428::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:44,428::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-37::DEBUG::2014-09-09 09:55:44,429::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-09-09 09:55:44,437::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n504 bytes (504 B) copied, 0.000964556 s, 523 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-09 09:55:44,437::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:44,437::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-09 09:55:44,437::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:44,438::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:44,438::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:44,438::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:44,438::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:44,438::__init__::225::IOProcess::(_processLogs) (92) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:55:44,438::__init__::225::IOProcess::(_processLogs) (92) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:55:44,438::__init__::225::IOProcess::(_processLogs) DEBUG|(92) Building response >Thread-14::DEBUG::2014-09-09 09:55:44,438::__init__::225::IOProcess::(_processLogs) (92) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:44,438::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-14::DEBUG::2014-09-09 09:55:44,439::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-14::DEBUG::2014-09-09 09:55:44,439::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:44,439::__init__::225::IOProcess::(_processLogs) Message size is 163 >Thread-14::DEBUG::2014-09-09 09:55:44,439::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:44,440::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:44,440::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:44,440::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:44,440::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:44,440::__init__::225::IOProcess::(_processLogs) (93) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:55:44,440::__init__::225::IOProcess::(_processLogs) (93) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:55:44,440::__init__::225::IOProcess::(_processLogs) (93) Building response >Thread-14::DEBUG::2014-09-09 09:55:44,440::__init__::225::IOProcess::(_processLogs) (93) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:44,440::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:44,440::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-14::DEBUG::2014-09-09 09:55:44,440::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:44,441::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-14::DEBUG::2014-09-09 09:55:44,441::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:44,441::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:44,441::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:44,441::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:44,441::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:44,441::__init__::225::IOProcess::(_processLogs) (94) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:55:44,441::__init__::225::IOProcess::(_processLogs) (94) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:55:44,441::__init__::225::IOProcess::(_processLogs) (94) Building response >Thread-14::DEBUG::2014-09-09 09:55:44,442::__init__::225::IOProcess::(_processLogs) (94) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:44,442::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:44,442::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-14::DEBUG::2014-09-09 09:55:44,442::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:44,442::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-14::DEBUG::2014-09-09 09:55:44,442::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:44,442::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:44,443::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:44,443::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:44,443::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:44,443::__init__::225::IOProcess::(_processLogs) (95) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:55:44,443::__init__::225::IOProcess::(_processLogs) (95) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:55:44,443::__init__::225::IOProcess::(_processLogs) (95) Building response >Thread-14::DEBUG::2014-09-09 09:55:44,443::__init__::225::IOProcess::(_processLogs) (95) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:44,443::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:44,443::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-14::DEBUG::2014-09-09 09:55:44,451::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:44,451::__init__::225::IOProcess::(_processLogs) Message size is 145 >Thread-14::DEBUG::2014-09-09 09:55:44,451::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:44,451::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:44,452::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:44,452::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:44,452::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:44,452::__init__::225::IOProcess::(_processLogs) (96) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:55:44,452::__init__::225::IOProcess::(_processLogs) (96) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:55:44,452::__init__::225::IOProcess::(_processLogs) DEBUG|(96) Building response >Thread-14::DEBUG::2014-09-09 09:55:44,452::__init__::225::IOProcess::(_processLogs) (96) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:44,452::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-35::DEBUG::2014-09-09 09:55:44,453::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-09 09:55:44,453::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-35::DEBUG::2014-09-09 09:55:44,459::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00109944 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-09 09:55:44,459::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:44,460::__init__::225::IOProcess::(_processLogs) Message size is 145 >Thread-14::DEBUG::2014-09-09 09:55:44,460::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:44,460::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:44,460::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:44,460::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:44,460::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:44,460::__init__::225::IOProcess::(_processLogs) (97) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:55:44,460::__init__::225::IOProcess::(_processLogs) (97) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:55:44,460::__init__::225::IOProcess::(_processLogs) DEBUG|(97) Building response >Thread-14::DEBUG::2014-09-09 09:55:44,460::__init__::225::IOProcess::(_processLogs) (97) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:44,461::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-14::DEBUG::2014-09-09 09:55:44,461::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-13::DEBUG::2014-09-09 09:55:47,223::task::595::Storage.TaskManager.Task::(_updateState) Task=`46998576-a0b9-4fd6-b093-447343b378aa`::moving from state init -> state preparing >Thread-13::INFO::2014-09-09 09:55:47,223::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-09-09 09:55:47,223::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109944', 'lastCheck': '2.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000964556', 'lastCheck': '2.8', 'valid': True}} >Thread-13::DEBUG::2014-09-09 09:55:47,223::task::1191::Storage.TaskManager.Task::(prepare) Task=`46998576-a0b9-4fd6-b093-447343b378aa`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109944', 'lastCheck': '2.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000964556', 'lastCheck': '2.8', 'valid': True}} >Thread-13::DEBUG::2014-09-09 09:55:47,223::task::595::Storage.TaskManager.Task::(_updateState) Task=`46998576-a0b9-4fd6-b093-447343b378aa`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-09-09 09:55:47,224::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-09-09 09:55:47,224::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-09-09 09:55:47,224::task::993::Storage.TaskManager.Task::(_decref) Task=`46998576-a0b9-4fd6-b093-447343b378aa`::ref 0 aborting False >Thread-14::DEBUG::2014-09-09 09:55:54,443::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:54,443::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-09 09:55:54,443::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:54,443::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:54,443::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:54,444::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:54,444::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:54,444::__init__::225::IOProcess::(_processLogs) (98) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:55:54,444::__init__::225::IOProcess::(_processLogs) (98) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:55:54,446::__init__::225::IOProcess::(_processLogs) DEBUG|(98) Building response >Thread-14::DEBUG::2014-09-09 09:55:54,446::__init__::225::IOProcess::(_processLogs) (98) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:54,446::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:54,446::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-37::DEBUG::2014-09-09 09:55:54,446::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-09-09 09:55:54,452::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n504 bytes (504 B) copied, 0.000986712 s, 511 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-09 09:55:54,453::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:55:54,453::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-09 09:55:54,453::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:54,453::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:55:54,453::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:54,453::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:54,454::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:54,454::__init__::225::IOProcess::(_processLogs) (99) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:55:54,454::__init__::225::IOProcess::(_processLogs) (99) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:55:54,454::__init__::225::IOProcess::(_processLogs) DEBUG|(99) Building response >Thread-14::DEBUG::2014-09-09 09:55:54,454::__init__::225::IOProcess::(_processLogs) (99) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:54,455::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:55:54,455::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-14::DEBUG::2014-09-09 09:55:54,455::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-14::DEBUG::2014-09-09 09:55:54,455::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:54,455::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:54,455::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:54,455::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:54,455::__init__::225::IOProcess::(_processLogs) (100) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:55:54,455::__init__::225::IOProcess::(_processLogs) (100) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:55:54,456::__init__::225::IOProcess::(_processLogs) (100) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:54,456::__init__::225::IOProcess::(_processLogs) Sending response sized 55 >Thread-14::DEBUG::2014-09-09 09:55:54,456::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-14::DEBUG::2014-09-09 09:55:54,456::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:54,456::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:54,456::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:54,456::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:54,457::__init__::225::IOProcess::(_processLogs) (101) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:55:54,457::__init__::225::IOProcess::(_processLogs) (101) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:55:54,457::__init__::225::IOProcess::(_processLogs) (101) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:54,457::__init__::225::IOProcess::(_processLogs) Sending response sized 55 >Thread-14::DEBUG::2014-09-09 09:55:54,457::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-14::DEBUG::2014-09-09 09:55:54,457::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:54,458::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:54,458::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:54,458::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:54,458::__init__::225::IOProcess::(_processLogs) (102) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:55:54,458::__init__::225::IOProcess::(_processLogs) (102) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:55:54,458::__init__::225::IOProcess::(_processLogs) (102) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:54,458::__init__::225::IOProcess::(_processLogs) Sending response sized 55 >Thread-14::DEBUG::2014-09-09 09:55:54,461::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-09 09:55:54,462::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:54,462::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:54,462::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:54,462::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:54,462::__init__::225::IOProcess::(_processLogs) (103) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:55:54,462::__init__::225::IOProcess::(_processLogs) (103) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:55:54,464::__init__::225::IOProcess::(_processLogs) (103) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:54,464::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-35::DEBUG::2014-09-09 09:55:54,464::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-35::DEBUG::2014-09-09 09:55:54,471::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00107506 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-09 09:55:54,472::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-09 09:55:54,472::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:55:54,472::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:55:54,472::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:55:54,472::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:55:54,472::__init__::225::IOProcess::(_processLogs) (104) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:55:54,472::__init__::225::IOProcess::(_processLogs) (104) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:55:54,473::__init__::225::IOProcess::(_processLogs) (104) Queuing response >Thread-14::DEBUG::2014-09-09 09:55:54,473::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-13::DEBUG::2014-09-09 09:56:02,375::task::595::Storage.TaskManager.Task::(_updateState) Task=`c78bc8f2-2d3d-4642-bdce-bc7221cb832e`::moving from state init -> state preparing >Thread-13::INFO::2014-09-09 09:56:02,375::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-09-09 09:56:02,376::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107506', 'lastCheck': '7.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000986712', 'lastCheck': '7.9', 'valid': True}} >Thread-13::DEBUG::2014-09-09 09:56:02,376::task::1191::Storage.TaskManager.Task::(prepare) Task=`c78bc8f2-2d3d-4642-bdce-bc7221cb832e`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107506', 'lastCheck': '7.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000986712', 'lastCheck': '7.9', 'valid': True}} >Thread-13::DEBUG::2014-09-09 09:56:02,376::task::595::Storage.TaskManager.Task::(_updateState) Task=`c78bc8f2-2d3d-4642-bdce-bc7221cb832e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-09-09 09:56:02,376::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-09-09 09:56:02,376::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-09-09 09:56:02,376::task::993::Storage.TaskManager.Task::(_decref) Task=`c78bc8f2-2d3d-4642-bdce-bc7221cb832e`::ref 0 aborting False >Thread-13::DEBUG::2014-09-09 09:56:02,497::BindingXMLRPC::318::vds::(wrapper) client [192.168.2.1] flowID [21a09433] >Thread-13::DEBUG::2014-09-09 09:56:02,497::task::595::Storage.TaskManager.Task::(_updateState) Task=`89c07111-9f22-48e5-892c-1003d3519d66`::moving from state init -> state preparing >Thread-13::INFO::2014-09-09 09:56:02,497::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-13::ERROR::2014-09-09 09:56:02,497::task::866::Storage.TaskManager.Task::(_setError) Task=`89c07111-9f22-48e5-892c-1003d3519d66`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 873, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 45, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 611, in getSpmStatus > status = self._getSpmStatusInfo(pool) > File "/usr/share/vdsm/storage/hsm.py", line 605, in _getSpmStatusInfo > (pool.spmRole,) + pool.getSpmStatus())) > File "/usr/share/vdsm/storage/sp.py", line 126, in getSpmStatus > return self._backend.getSpmStatus() > File "/usr/share/vdsm/storage/spbackends.py", line 416, in getSpmStatus > lVer, spmId = self.masterDomain.inquireClusterLock() > File "/usr/share/vdsm/storage/sd.py", line 515, in inquireClusterLock > return self._clusterLock.inquire() > File "/usr/share/vdsm/storage/clusterlock.py", line 149, in inquire > raise InquireNotSupportedError() >InquireNotSupportedError >Thread-13::DEBUG::2014-09-09 09:56:02,497::task::885::Storage.TaskManager.Task::(_run) Task=`89c07111-9f22-48e5-892c-1003d3519d66`::Task._run: 89c07111-9f22-48e5-892c-1003d3519d66 ('5745e11d-81b4-4d82-8fed-c8a22ec23383',) {} failed - stopping task >Thread-13::DEBUG::2014-09-09 09:56:02,498::task::1217::Storage.TaskManager.Task::(stop) Task=`89c07111-9f22-48e5-892c-1003d3519d66`::stopping in state preparing (force False) >Thread-13::DEBUG::2014-09-09 09:56:02,498::task::993::Storage.TaskManager.Task::(_decref) Task=`89c07111-9f22-48e5-892c-1003d3519d66`::ref 1 aborting True >Thread-13::INFO::2014-09-09 09:56:02,498::task::1171::Storage.TaskManager.Task::(prepare) Task=`89c07111-9f22-48e5-892c-1003d3519d66`::aborting: Task is aborted: u'' - code 100 >Thread-13::DEBUG::2014-09-09 09:56:02,498::task::1176::Storage.TaskManager.Task::(prepare) Task=`89c07111-9f22-48e5-892c-1003d3519d66`::Prepare: aborted: >Thread-13::DEBUG::2014-09-09 09:56:02,498::task::993::Storage.TaskManager.Task::(_decref) Task=`89c07111-9f22-48e5-892c-1003d3519d66`::ref 0 aborting True >Thread-13::DEBUG::2014-09-09 09:56:02,498::task::928::Storage.TaskManager.Task::(_doAbort) Task=`89c07111-9f22-48e5-892c-1003d3519d66`::Task._doAbort: force False >Thread-13::DEBUG::2014-09-09 09:56:02,498::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-09-09 09:56:02,498::task::595::Storage.TaskManager.Task::(_updateState) Task=`89c07111-9f22-48e5-892c-1003d3519d66`::moving from state preparing -> state aborting >Thread-13::DEBUG::2014-09-09 09:56:02,498::task::550::Storage.TaskManager.Task::(__state_aborting) Task=`89c07111-9f22-48e5-892c-1003d3519d66`::_aborting: recover policy none >Thread-13::DEBUG::2014-09-09 09:56:02,498::task::595::Storage.TaskManager.Task::(_updateState) Task=`89c07111-9f22-48e5-892c-1003d3519d66`::moving from state aborting -> state failed >Thread-13::DEBUG::2014-09-09 09:56:02,498::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-09-09 09:56:02,498::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::ERROR::2014-09-09 09:56:02,498::dispatcher::79::Storage.Dispatcher::(wrapper) >Traceback (most recent call last): > File "/usr/share/vdsm/storage/dispatcher.py", line 71, in wrapper > result = ctask.prepare(func, *args, **kwargs) > File "/usr/share/vdsm/storage/task.py", line 103, in wrapper > return m(self, *a, **kw) > File "/usr/share/vdsm/storage/task.py", line 1179, in prepare > raise self.error >InquireNotSupportedError >Thread-14::DEBUG::2014-09-09 09:56:04,459::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-09 09:56:04,459::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:56:04,459::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:56:04,460::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:56:04,460::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:56:04,460::__init__::225::IOProcess::(_processLogs) (105) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:56:04,460::__init__::225::IOProcess::(_processLogs) (105) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:56:04,460::__init__::225::IOProcess::(_processLogs) (105) Queuing response >Thread-37::DEBUG::2014-09-09 09:56:04,461::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-09 09:56:04,461::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:56:04,465::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-37::DEBUG::2014-09-09 09:56:04,469::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n505 bytes (505 B) copied, 0.000947679 s, 533 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-09 09:56:04,470::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-09 09:56:04,470::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:56:04,470::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:56:04,470::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:56:04,470::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:56:04,470::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:56:04,470::__init__::225::IOProcess::(_processLogs) (106) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:56:04,470::__init__::225::IOProcess::(_processLogs) (106) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:56:04,471::__init__::225::IOProcess::(_processLogs) DEBUG|(106) Building response >Thread-14::DEBUG::2014-09-09 09:56:04,471::__init__::225::IOProcess::(_processLogs) (106) Queuing response >Thread-14::DEBUG::2014-09-09 09:56:04,471::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:56:04,471::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-14::DEBUG::2014-09-09 09:56:04,472::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:56:04,472::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-14::DEBUG::2014-09-09 09:56:04,472::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:56:04,472::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:56:04,472::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:56:04,472::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:56:04,472::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:56:04,473::__init__::225::IOProcess::(_processLogs) (107) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:56:04,473::__init__::225::IOProcess::(_processLogs) (107) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:56:04,473::__init__::225::IOProcess::(_processLogs) (107) Building response >Thread-14::DEBUG::2014-09-09 09:56:04,473::__init__::225::IOProcess::(_processLogs) (107) Queuing response >Thread-14::DEBUG::2014-09-09 09:56:04,473::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:56:04,473::__init__::225::IOProcess::(_processLogs) Sending response sized 55 >Thread-14::DEBUG::2014-09-09 09:56:04,473::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:56:04,473::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-14::DEBUG::2014-09-09 09:56:04,473::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:56:04,473::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:56:04,474::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:56:04,474::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:56:04,474::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:56:04,474::__init__::225::IOProcess::(_processLogs) (108) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:56:04,474::__init__::225::IOProcess::(_processLogs) (108) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:56:04,474::__init__::225::IOProcess::(_processLogs) (108) Building response >Thread-14::DEBUG::2014-09-09 09:56:04,475::__init__::225::IOProcess::(_processLogs) (108) Queuing response >Thread-14::DEBUG::2014-09-09 09:56:04,475::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:56:04,475::__init__::225::IOProcess::(_processLogs) Sending response sized 55 >Thread-14::DEBUG::2014-09-09 09:56:04,475::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:56:04,475::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-14::DEBUG::2014-09-09 09:56:04,475::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:56:04,475::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:56:04,476::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:56:04,476::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:56:04,476::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:56:04,476::__init__::225::IOProcess::(_processLogs) (109) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:56:04,476::__init__::225::IOProcess::(_processLogs) (109) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:56:04,476::__init__::225::IOProcess::(_processLogs) (109) Building response >Thread-14::DEBUG::2014-09-09 09:56:04,476::__init__::225::IOProcess::(_processLogs) (109) Queuing response >Thread-14::DEBUG::2014-09-09 09:56:04,476::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:56:04,476::__init__::225::IOProcess::(_processLogs) Sending response sized 55 >Thread-14::DEBUG::2014-09-09 09:56:04,476::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:56:04,477::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-09 09:56:04,477::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:56:04,477::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:56:04,477::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:56:04,477::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:56:04,477::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:56:04,477::__init__::225::IOProcess::(_processLogs) (110) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:56:04,477::__init__::225::IOProcess::(_processLogs) (110) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:56:04,477::__init__::225::IOProcess::(_processLogs) DEBUG|(110) Building response >Thread-35::DEBUG::2014-09-09 09:56:04,478::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-09 09:56:04,478::__init__::225::IOProcess::(_processLogs) (110) Queuing response >Thread-14::DEBUG::2014-09-09 09:56:04,482::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:56:04,482::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-35::DEBUG::2014-09-09 09:56:04,483::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.000873067 s, 1.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-09 09:56:04,484::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:56:04,484::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-09 09:56:04,484::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:56:04,484::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:56:04,484::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:56:04,484::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:56:04,484::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:56:04,485::__init__::225::IOProcess::(_processLogs) (111) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:56:04,485::__init__::225::IOProcess::(_processLogs) (111) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:56:04,485::__init__::225::IOProcess::(_processLogs) DEBUG|(111) Building response >Thread-14::DEBUG::2014-09-09 09:56:04,486::__init__::225::IOProcess::(_processLogs) (111) Queuing response >Thread-14::DEBUG::2014-09-09 09:56:04,486::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:56:04,486::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-14::DEBUG::2014-09-09 09:56:14,476::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:56:14,476::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-09 09:56:14,476::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:56:14,476::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:56:14,476::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:56:14,476::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:56:14,477::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:56:14,477::__init__::225::IOProcess::(_processLogs) (112) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:56:14,477::__init__::225::IOProcess::(_processLogs) (112) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:56:14,477::__init__::225::IOProcess::(_processLogs) DEBUG|(112) Building response >Thread-14::DEBUG::2014-09-09 09:56:14,477::__init__::225::IOProcess::(_processLogs) (112) Queuing response >Thread-14::DEBUG::2014-09-09 09:56:14,477::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-37::DEBUG::2014-09-09 09:56:14,478::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-09 09:56:14,478::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-14::DEBUG::2014-09-09 09:56:14,486::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-37::DEBUG::2014-09-09 09:56:14,487::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n505 bytes (505 B) copied, 0.000932474 s, 542 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-09 09:56:14,487::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-09 09:56:14,488::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:56:14,488::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:56:14,488::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:56:14,488::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:56:14,488::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:56:14,488::__init__::225::IOProcess::(_processLogs) (113) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:56:14,488::__init__::225::IOProcess::(_processLogs) (113) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:56:14,488::__init__::225::IOProcess::(_processLogs) DEBUG|(113) Building response >Thread-35::DEBUG::2014-09-09 09:56:14,489::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-09 09:56:14,489::__init__::225::IOProcess::(_processLogs) (113) Queuing response >Thread-14::DEBUG::2014-09-09 09:56:14,493::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:56:14,494::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-35::DEBUG::2014-09-09 09:56:14,496::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00107643 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-09 09:56:14,496::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:56:14,496::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-09 09:56:14,497::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:56:14,497::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:56:14,497::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:56:14,497::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:56:14,497::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:56:14,497::__init__::225::IOProcess::(_processLogs) (114) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:56:14,497::__init__::225::IOProcess::(_processLogs) (114) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:56:14,497::__init__::225::IOProcess::(_processLogs) DEBUG|(114) Building response >Thread-14::DEBUG::2014-09-09 09:56:14,498::__init__::225::IOProcess::(_processLogs) (114) Queuing response >Thread-14::DEBUG::2014-09-09 09:56:14,498::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:56:14,498::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-14::DEBUG::2014-09-09 09:56:14,498::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:56:14,498::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-09 09:56:14,498::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:56:14,498::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:56:14,498::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:56:14,499::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:56:14,499::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:56:14,499::__init__::225::IOProcess::(_processLogs) (115) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-09 09:56:14,499::__init__::225::IOProcess::(_processLogs) (115) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-09 09:56:14,499::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:56:14,499::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-14::DEBUG::2014-09-09 09:56:14,499::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:56:14,499::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:56:14,499::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:56:14,500::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:56:14,500::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:56:14,500::__init__::225::IOProcess::(_processLogs) (116) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:56:14,500::__init__::225::IOProcess::(_processLogs) (116) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:56:14,500::__init__::225::IOProcess::(_processLogs) (116) Building response >Thread-14::DEBUG::2014-09-09 09:56:14,500::__init__::225::IOProcess::(_processLogs) (116) Queuing response >Thread-14::DEBUG::2014-09-09 09:56:14,500::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:56:14,500::__init__::225::IOProcess::(_processLogs) Sending response sized 55 >Thread-14::DEBUG::2014-09-09 09:56:14,500::__init__::225::IOProcess::(_processLogs) (115) Building response >Thread-14::DEBUG::2014-09-09 09:56:14,500::__init__::225::IOProcess::(_processLogs) (115) Queuing response >Thread-14::DEBUG::2014-09-09 09:56:14,500::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:56:14,500::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-14::DEBUG::2014-09-09 09:56:14,501::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:56:14,501::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-14::DEBUG::2014-09-09 09:56:14,501::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:56:14,501::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-09 09:56:14,502::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:56:14,502::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:56:14,502::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:56:14,502::__init__::225::IOProcess::(_processLogs) (117) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:56:14,502::__init__::225::IOProcess::(_processLogs) (117) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:56:14,502::__init__::225::IOProcess::(_processLogs) (117) Building response >Thread-14::DEBUG::2014-09-09 09:56:14,502::__init__::225::IOProcess::(_processLogs) (117) Queuing response >Thread-14::DEBUG::2014-09-09 09:56:14,502::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:56:14,502::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 55 >Thread-14::DEBUG::2014-09-09 09:56:14,503::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-09 09:56:14,503::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-14::DEBUG::2014-09-09 09:56:14,503::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-09 09:56:14,503::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-09 09:56:14,503::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-09 09:56:14,504::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-09 09:56:14,504::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-09 09:56:14,504::__init__::225::IOProcess::(_processLogs) (118) Finding callback 'access'... >Thread-14::DEBUG::2014-09-09 09:56:14,504::__init__::225::IOProcess::(_processLogs) (118) Got request for method 'access' >Thread-14::DEBUG::2014-09-09 09:56:14,504::__init__::225::IOProcess::(_processLogs) (118) Building response >Thread-14::DEBUG::2014-09-09 09:56:14,504::__init__::225::IOProcess::(_processLogs) (118) Queuing response >Thread-14::DEBUG::2014-09-09 09:56:14,504::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-09 09:56:14,504::__init__::225::IOProcess::(_processLogs) Sending response sized 55 >Thread-13::DEBUG::2014-09-09 09:56:17,507::task::595::Storage.TaskManager.Task::(_updateState) Task=`151ed650-fa2c-44d2-9aa5-ec305381efd0`::moving from state init -> state preparing >Thread-13::INFO::2014-09-09 09:56:17,507::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-09-09 09:56:17,507::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107643', 'lastCheck': '3.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000932474', 'lastCheck': '3.0', 'valid': True}} >Thread-13::DEBUG::2014-09-09 09:56:17,507::task::1191::Storage.TaskManager.Task::(prepare) Task=`151ed650-fa2c-44d2-9aa5-ec305381efd0`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107643', 'lastCheck': '3.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000932474', 'lastCheck': '3.0', 'valid': True}} >Thread-13::DEBUG::2014-09-09 09:56:17,507::task::595::Storage.TaskManager.Task::(_updateState) Task=`151ed650-fa2c-44d2-9aa5-ec305381efd0`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-09-09 09:56:17,507::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-09-09 09:56:17,507::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-09-09 09:56:17,508::task::993::Storage.TaskManager.Task::(_decref) Task=`151ed650-fa2c-44d2-9aa5-ec305381efd0`::ref 0 aborting False
<b>You cannot view the attachment while viewing its details because your browser does not support IFRAMEs. <a href="attachment.cgi?id=935730">View the attachment on a separate page</a>.</b>
View Attachment As Raw
Actions:
View
Attachments on
bug 1139401
:
935464
|
935730
|
935878
|
935879
|
935880
|
935881
|
935882
|
935883